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EXECUTIVE SUMMARY 



this report represents the completion of an_ extensive evalu- 
ation 6£ pre-eroplbySeht prbgraSos as potential strategies for 
moving disady an tagged j^j)t^^ private sector jobs. The_ report 

inspects long-run impacts on par t icij>ants in five 70001 Pre- 
employment Programs , who enrolled in these programs between 
January 1971J and April 1980, by analyzing data fr^ follbw-up 
interviews of participant and comparison youth between 24 and 40 
months after intake into the prbgraiti* 

The 70001 Prog ram 

70001 ttd. is a national organization with over 5? locally 
bperatinil programs, designed primarily to serve disadvahtag 
youths The prpgt am couples inodest job-readiness and ^edacatibhal 
traihihg with job placement in order to help youth gaiji a hbld in 
the labor market. Pre-employment training provided by the 
program includes but is not limited to such activities as how to 
fill dUt a job application, how to handle oneself in a j?^ 
interview^ shaping realistic work behavior, and how to interpet 
help-wanted ads. The average participant r^Kreives 32 hours of 
such training. Participants also receive career counseling, job 
placement, and the opportunity to take GED classes w 

70001 participants range in age between 16 and 21. ftil are 
economically disadvantaged^ ah^ over 80% came from minority 
groups. Sixty percent are women ^ Practically all of the 
participants are high school dropouts^ 

Research Tasks 

The research in this report focused on 975 youth in five 
cites._ The participant group consists of th©^ntir# pbpulatibh 
of 535 youth who enrolled in the 70001 program between January 
1979 and ilpril 1980 in the five directly-operated sites of 
Atlari^^^ Bbstbh* Richmond, San Antonio, and tulsai the 
comparison gi^njp is made up of 44f iitnilar youth f rep the same 
citii^s, and frbx: the most part drawn from lists of registrants at 
locai job service offices. It is important to ftbte that the 
^t/*i*y used a cottparisah ^roap rather thasi control group 
methodology^ Psfticipaht and cosparfson jyoufch are very similar 
ir^ terns of background char seter i fife ics^ but they were nb£ 
rafidoiTjiy assigned to each group* 

Two previous reports on teMs sample oh^ ba»^^^ on folJow-up 
dat^s averaging nine months since lrU:ak# the second toas^ on 

follow-up dat^ averaging four teem montfts ^ince ijitake — found 
that 700@l participants had statistically sSghif icahtly higher 
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earnings than comparisbh. youth. The purpose of this 
consisting of f5lioW-up ihtef views .taken between 24 and 40 month^ 
since intake - was to determine if the early positive effects of 
the 73001 program persisted over time. 

Key Outcomes examined in this report include weekly e|rnings, 
probability- of employment, and occupational attainment. These 
oatcbmes are studied both at the pbiht-ir.-time of the 24 to 
40-lonth fOllow-up in May and 3one of 1982 and fo. calendar year 
1981 Th^ outcomes in this third £bllow-up wave are also 

cllpa'red wi%h ?hf results ^-o. J^^ -^^^'^Ul^^ l^fause 
order to determine changes over time in program effec^ts. Because 
sTT th*» interviews in this 24 to 40~inonth follow-up toqK p±ace 
lurini a r4J4i?n, and^b^^^ the females in the sample are in 
an age grourcha^acterized by high rates of childbearing, special 
attention paid in the report to separating out recessionary 

anf chUdbearing effects from change s over time in program 
effects* 

Results 

Before discussing results, it ij«P°^taht Jo n^^^ the 
70001 pro-grams that we chose for follow-up interviews 'that is^ 
the directly-operated ones) performed better on short term 
o™"lasLes (Placement in Jobs) than those -^^^^^ 
lot fbllow-up. This might suggest not only tjiat one c^not 
ql^eraliil from these five sites, but also that analyses based on 
Ihem ^ight overstate the benefits to youth. 

one must be cautious at taking these results (from 6X^.^*1^^^ 
programs in 1979 and 1980) ^ and generalizing^ to 7000^ pro^^^^ 
?oday since some mbd i f ica tions have undoubtedly been mzde to 
strengthen the benefits to youth. 

The following findings are derived from the last wave of 
fbllbw-up interviews on 70001: 

o ftfter doing various model specificitiojis^ we fou«a Jo 
statistically significant evidence faat tbe 70001 programs 
investigated here have impacts on the^ longer run 
employability of their participants. .r^'^thl 
effects of the program were found at "9" and -14" months 
af tef intake'%y the 24 to «--««th po^t-Jntake pe.iod. 
theie <?^fects appeared to have decayed. Tne effects in 
the 24 to 40-month post-intake period "ear^zero f or 

the total sample and for males, but negative a"'f^|tatis^ 
tically significant for: females, we _ found n° f \^|"|f °| 
the impact of 70001 on the occupational skill level ot 
participants nor on the annual earnings of P^'^H^^P^^I^^s 
calendar year 1981, that is, 21 to 33 months after program 
intake, 

vi ii 



6 The apparent decay of program effects iil this 24. to 40- 
mohth period appear^ to result in large part from an 
iSprevemerxt in the labor market position of the compar|.son 
group, in the face of a deep recession, at the same _ time 
that the participants are experiencing a slight deteriora- 
tion of their position in the labor market. There is 
little convincing evidence that the recession was largely 
responsible for the decay of program effects. Differen- 
tial childbearing by the participant arid comparison groups 
canriot explain the negative progjram effects for females, 
although childbearing and responsibility for dependents 
has clearly been influential in the differential patterns 
of labor foice behaviors of the male and female 
participants . 

o In this longer term follow-up, 70001 sites investigated 
here were shown to have a positive impact on GED 
attairimerit . 

o The program is relatively inexpensive when compared^ with 
other treatment modalities. However, it is one of the 
more expensive pre-employment programs. 

o When using a "pay-bacR" arialysis, the program is not cost- 
effective for females, as females can riever pay back the 
cost of the prograra. the program is quite cost-effective 
for males as they pay back the cost of the program in just 
over one year, and is almost, but not quite cost-effective 
for the overall sample* as participants come close to but 
ate never quite able to pay back the cost of the program, 
(Note that this reversal from the earlier report rs due to 
the fact that early participant gains were offset by 
subsequent participant losses relative to the comparison 
g roup. ) 

In ium, these results suggest that our research has provided 
evidence that tffe 70001 programs investigated here ^hav^ a 
positive effect in the short run, but no evidence was found ^to 
iuggest that 70001 had longer run impacts on youth s 
emplbyability . 

XwpLtc aJb iong for Pol i cy^^Hakers 

The research confims that well-run pre-employment programs 
such as 70001 can: 



place disadvantaged, out-of-school youtJi in private sector 
lobs at a low cost per placement and without offering 
direct subsidies to employers (nor do employers take 
advantage of tax credits) 

attract same youth to job-readiness training activities 
without paying a stipend 
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b increase youth earnings, at least temporarily^ relative to 
a comparisbri grbup 

o work fbr youth tihder 18 as well as for older youth 



Mbrebver, it shbUld be noted that the 70001 programs investigated 
here have a mbre enduring labor market impact than many j)ther 
such pre-employ-<t!ht prbgrams studied through the Department b£ 
Labor . 

HbWeVer, we have found no evidence that the 70001 programs 
investigated here have permanent or long ran effects on the 
emplbyability bf ybUth, as measured by subsequent likelihbbd bf 
employment, earnings or type of job held at 24 to 40 months after 
intake to the prbgram. (Note, in this longer term follow-up^ 
participation in 70001 did positively affect GED attainment.) 
Thus, while the prbgram meets many of its obiectives, such as 
placing youth in private sector jobs and increasing earnings in 
the short run, we find no evidence bf the ability of these five 
70001 programs to permanently affect the youths' longer-run 
emplbyability. in short, the programs place ybuth in private 
sector jbbs, allowing them to reap earnings gains, but eventually 
comparison group members Will get jobs on their own and the 
advantage to par ticipants disappears . Despite the fact that the 
70001 programs meet many important objectives, one is left 
Wbndering whether pre-employment programs such as 70001 are good 
social investments. For while these programs are able to 
increase participants' earnings in the short run, they do not 
appear to be able tb increase youths' earnings in the long run. 
Additional iriterVeritiOris might be required subsequent to pre- 
emplbyment experience to sustain the earnings gains produced by 
the prbgram. Especially for ybuth under 18 years of age, pre- 
employmeht programs like 70001 may be only the first step in a 
series of necessary interventions. 
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CHAPTER I 



INTRODUCTION 



Since 1978, Public/Private Ventures has beeil conducting a 
multi-site demonstration project for the Department of Labor 
Office of Youth Programs. the pro ject aimed at develop 
assessing a variety of approaches to private sector participation 
in employment and training programs for 16 to_2i year-old, econo- 
mically disadvantaged,^ but-bf-schbbl ybuth. Overwhelmingly these 
are poor, minority drop-outs who find getting work to be a "'mad- 
dening, dead-end course." The Private Sectbr Demonstration em- 
compassed six distinct interventi^qns: pre-emplbyihent services ^ 
temporary work eicperience, targeted skills train 
work experiecDcef youth entrepreneurship and small business in- 
centives. Pinal rep/orts from each intervention have been com- 
pleted. 

P/PV*s wdurk on pre-emplbymerit programs focused on two such 
programs: 70^01 Ltd i and Jobs fbr Jbuth^ Inc. To date, two re- 
ports have been written which summarize the results from the 
fdllow-up interviews which were collected at "nine" ^ and 
••fourteen" months post-intake (approximately thre^ and eight 
months after the "termihation time", which was arti f iciaily set 
at six months post-intake. J ^ While these two reports were to 
have been the completjbh of the investigation of the effects of 
pre-employment programs on disadvantaged youths the results from 
the second report wjete such that it seemed appropriate to do an 
additional wave of fol low-up interviews on one of these programs, 
70001 Ltd. This report, there fore , analyzes these__last wave 
follow-up data in order to^ inspect the longer term effects of a 
particular pre-employment program. This chapter sets the Stage 
for the rest of the report by first recount ing the earlier 
results (and the puzzles tAieirein) , discussing the basic research 
design used ir this third wave inter views , describing the 
70001 model and th^n outlihihg the chapters to cojfne. 

Results from the Earl ier Re s e a rch 



The earlier research ' on 70001 and the JFY program in 
Boston indicated that these programs: 

o place disadvantaged^ but-bf-schobl youth in private sector 
jobs at a low cost per placement and_ without of fering 
direct subsidies to employers (nor do employers take 
advantage of tax credits) i 

o attract youth to job-readiness training activities without 
paying a stipend. 

b increase ybuth^s earnings^ ^[t least teraporarily# in 
amounts sufficient to make the programs cost-effective^ 
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o work for youth under 18 as well as for older youth. 

While these general statetnehts can be made about both programs, 
70001 and JFY exhibited different patterns of program impacts 
over tithe. 

o 70001 had a positive and statisticaUy significant effect 
on the short-run earnings of XO«th' the „ effect 

appreciated over time, at least through the ••14 moQth 
pllt-intaks period. "Rine- ^°nths after .ntalce,^ 70001 
youth were earning an average of 514;15 more per week tha^ 
their matched comparison counterparts °ther factors 

were held c^sns tan t. At "14" months, the difference had 
grown to $24.40. 

o JFY Boston had pronounced and statistically sigSif icant 
short-run effects on the earnings of its pajti|ipanj:s^, but 
by month "14," the net earnings impact of .^J^vr^^J^^ 
comparison group had decreased and .^A^^ot .statistically 
siqnificant. "Nine" months after intake, JFY had ^a net 
imbact of $28.08 on the weekly earnings of participants 
ov^rtheir 'comparison cohort. By -14" ^l^fj^-^^f 
this impact was $12.02 and was not statistically 
significant relative to comparison group earnings. 

The JFY effects were net puzzling. Often, in pre-employment 
type programs which are inexpensive and °f . dur^^^^ 
aratn effScts "decay*' over time as members of the comparison groyp 
Iventualtr f ind 30bs and achieve Parity with participants^ t 
IfilC^d be^ot^d It the outset that effect ov^r 

this report refers to a "lessening of an impact or effect over 
tirnl-' Decay does hot necessarily imply that participants are 
doinq worse over time, only that the gap between participants and 
coiplrisoni Is liminishihg. However, 7000l's increasing effects 
overtime as well as the divergent patterns for the two programs 
were surprising; 

We could not account f5r these surprising findings without 
farther study. Several potential explahations for these results 
were Assessed empirically and then .J^^t attrition in the 

follow-up sample, differences among the sites in which tjie pro 
graml wefe locate'd, the presence of some atypical ly high earners, 
and the differences in the sex composition of the two programs. 

TWO potential explanations remained. The first related to 
the fundamental differences be-.ween the two programs em- 
phasized rapid non-individualized placement, and moderate 
ler?crievels, which could result in a rapid gain but ^an ^equally 
^apid decay. On the other hand, 70001 with its ^o^A ^"f^^^^^^^^^- 
ized job placement system and Sore intensive services (^"^ "ore 
post-placement services), might be expected to exhibit a delayed 
but more prolonged impact. 



Yet^ it Wotjid be incorrect to accept thi? jjxpianation before 
ruiing out an "arti factual " one that could also expla.in the dif- 
ferential patterns of program impact; There^ is rib official time 
of termihatibh from either Of these programs, so ah artificial 
termination date of six months after intake was chosen, after it 
was determined that part icipahts , . by and large, had no further 
contact with the program after this point. It is possible that 
this artificial termination date is tod early for 70001 or too 
iate for JFY. If this is the case, it is likely that there is a 
time lag problem, such that 70001 's program impact would look 
exactly like JFY's (strong early gains with a rapid decay), if 
the time lag problem were taken into account. 

This explanation could not be assessed without another wave 
of fbliow-un interviews. If 70001's impact has decayed at _ the 
next wave of iSterviews^ then this would provide some empirical 
support for the explanation of the earlier surprising results 
that the pattern of effects is similar for the two programs, with 
the effects for 70001 lagged a number of months (perhaps due to 
the artificial termination date). If 7000i's effects do not 
decay, or decay quite slowly, then we must revert to the 
explanation cbhcerhihg differential program services. 

Research Questions ahd^eseareh Design 

The basic question to be answered is: what a^e the longer run 
impacts Of the 70001 program? Additionally^ the follow-up data 
help distinguish between stepping stone and aging vat concepts of 
pre-eihplbymeht programs. If the m^inim^im wage jbba found for pro- 
gram participants are stepping stones to skilled careers, then 
the 24 to 40-mbhth follow-up data should begin picking up some 
movement in the participant sample to higher skii led jobs *^ If 
the minimum wage jobs are helpful as aging vats for participant 
youth, then participants should have higher rates of employment 
and labor market participation than cbmparisbri youth. 

Tb address these basic questibhs, ah additional wave of 
foiibw-up interviews was completed for the five 70001 programs 
previously investigated. It was decided that _ additional 
interviewihg was nbt necessary for the JFY participant and 
comparison samples, since JFY's effects had decayed by the last 
wave of interviewing. 

After funds were received from the Department of tabbr,^ all 
youths who were in the original 70001 participant or comparison 
samples were scheduled for interview in Hay and June of 1982. 
This was between 24 and 40 months after their initial entry into 
the prbgram (or in the case of the comparison group* from^the 
time they sought services). The Institute for Survey Research at 
Temple university conducted the fbllbw-up interviews and obtained 
an impressive 86% response rate^ 
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Before butlihirig the rest of the report, we will btiefly 
describe the 70001 pre-empibyment program model. (The reader is 
referred to the two earlier reports on pre-eitiplo^ent services 
for a lengthier description of the prbgraffls.j The term "P^e- 
employment services" has been applied tb career counsel inq^job- 
readihess training, self-directed job search instruction^ 
retnediai educatibh, "try before hire" agreem^ents and a host of 
other service bfferings. Iti this report, however, the opera- 
tional definition is perhaps best convej^ed by functionally 
synbpsizing the 70001 programs investigated here r that is, the 
70001 program as operated in five sites between January^ 1979 and 
April 198§» They couple modest job-readiness and educational 
training with jbb placement in order to help young peojile gain a 
Hold in the labor market in such entry-level 30^s^as are 

available to unskilled workers. They provide youth with 

intensive but limited doses of career counseling, educational 
services, arid pre-employment training, featuring such activities 
as 1) how to fill bUt a job application, 2) how to handle 
oneself in a job iriterview, 3) shaping realistic work behaviors^ 
such as. punctuality and proper dress, and 4) how to interpret 
help-wanted ads. 

ft distiriguishirig feature of 70001 is that rib financial 
incentives are paid. YbUth receive no stipend for participating 
in the training; emplbyers receive no reimbursement for hiring a 
youth. It is worth rioting that the term "pre-employment" program 
is Sbmewhat of a misnomer for 70001 because close contact is con- 
tinued with youth as well as emplbyers after placement m pri- 
vate sector jobs. 

70001 wa':i begun in 1969 and withiri a decade burgeoned to oyer 
fifty local programs, bound together by a strong national office, 
its domiriant modus bperandi is a network of affilfiated programs, 
each administered by a local sponsoring agency and funded largely 
via CETft prime sponsors. The central office, comsisting of ^ap- 
proximately fifty staff, supports each local progixam by providing 
techriical assistance, help in screening and hiring staff, cen- 
tralized staff training, and prombtibrial materials. The central 
office, located in Washington, b.C., is buoyed by an active board 
6f directbrs. Iri addition, a national advisory business group 
and a riatibriai bipartisan CbngressionJiil advisory association fyr- 
nish high visibility and clbse cbntact witlj business and legisla- 
tive developments^ 

The orototypical 70001 delivery agency is by desigri^hbfe 
large. Most serve from 75 to 125 ybUth per year. The typical 
participant In the sample studied here was 17 or 18 years old at 
iritake, black and economicaiiy disadvantaged. practically all 
youth were high school drop-outs (99%) with one-fifth of these 
cbmpleting only the eighth grade or less. Not surprisingly, | 
large segment read at a level well below chronological age;^ 50t 
of the participants bbtairied less than a seventh grade equiva- 




lehcy score bh the Adult Basic Learning Examination (ftBfcE)^ In 
terms of previous work experience, three out of ten youths had 
never held a regular jbb^ Of the youth citing previous jobs^ 
practically ail were secondary labor market positions, with a 
third of these paying below the mihimum wage* 

Sixty percent of the 70001 participants are women 70001 
staff suggest that female enrollees may be at tr acted to the 
program's more traditional edycat ional of ferings because the 
maji^rity of these women were "forced** to leave school due to 
pregnancy and welcome the prospect of 70001VS General Educational 
beveiopmeht (GED) course. Recruiting patterns have also been 
suggested^ with the rationale being that the peer grapevine, the 
most common source of youth referral , tends to promulgate along 
sexual lines* If early participants are mostly female, later 
ones will also be female, and vice versai 

The typical participant hears about, the program from friends^ 
but 70001 has made good use of media advertising, which accounts 
for one in four participants* awareness of 70001. First contact 
consists of explaining the program anj inviting youth to a small 
group orientation. These range in duration across local sites 
from a half-^day to a full week. Or ientatioh aims at prqviding 
youth sufficient information_ about program requirements and 
activities so that each young person can inake a knowledgeable 
deeisidn about entering the formal phase of the prbgrann. 

For thbse whb proceed, each must successfully complete a man- 
dated (16 hburs raihimum) classroom reg linen that focuses on 
preparation for labor market entry . This component, dubbed PET 
(Pre-Employment training) , includes sucli consent areas as identi- 
fying arid responding to job openings, grooming and proper dre$s, 
workplace requiremerits such as punctuality and courtesy, f illihg 
out job applications, and the like. Full-time instructors apply 
a variety of techniques such as rble play, video-tape feedback 
and field trips to busihessesi From 50 to 80 percJ^nt of «ach 
class completes PET, the average participant received 32 hours of 
pre-employmen> training. 

Graduation typical iy is followed by job placement ^ which 
occurs through nn individualized process^ ft roster of employers, 
whb have shown Interest based on previous part iclpat ion or 
earlier visits arid mai lings, is used in focusing the job search. 
Half of the ybuth who enter the 70001 program are successfully 
placed in uhsubsidized jobs. As a means to job acquisition, 
emphasis is placed on job-readiness tra inirig f social ization^ 
community values and especially education in the form of GriD 
study.. However, no relationship was evident between degree or 
type of service received and job placenienti 

While mbst job development is accomplished by local staffs 
some is dbhe with the assistance of the ceiitrai office, which 
solicits local leads arid reconsnendations from national business 
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aiiSciations. Staff try to "'Atch .a .prospective employe^ 
given youth's ihterests ana..e«l5iHtiesi .Personal conta^cts with 
firms are made by 70001 staff usually in the forn, of a Ph©"^ ^all 
followed by an interview at the place.of business.^ Although 
th^te is some variance in approach, staff tend to dovnplay a 
"hire a disadvantaged youth" appeal and accentuate the fact tnat 
the youth desires to work and has successfully completed an 
intensive job-readiness program^ 

Since most staff at 70001 implement all program functions^, it 
is usually true that the staff member who develops ^^^e 3oA^iS 
also the counselor who assigns the youth to that Dob. The ^7000 1 
program stresses a young person's retention of ^^^{^f ^^^J 
job placement. Staff at 70001 conunoniy accompany the candidate 
io interviews and use the experience in subsequent ^counseling 
sessions. The 70001 "job coordinator" continues post-placem^^^ 
contact with youth Snd employers in order to respond to problems. 

Education is accentuated at 70001, .although it is not 
compulsory in all sites. Standardized curricula are used at both 
the pre-GED and (jED level, and youth who do go on to gain a GED 
ire cited in 70001's national magazine. Often y°«th wiU spend 
raorhings in the PET s^qu^hce and afternoons in formal education 
endeavors. For youth who have obtained jobs, evening classes are 
offered so that they can continue studying for th^irGEp^cert it t- 
ca«-e. the educational cc^nponent is so pronounced at 70001 that 
in several cities 70001 is perceived by youth ^"fJ^J"' 
cies as much as an alternative school as f'^ «'"Pl°y'"^"^ 
Youth in the sample studied averaged ten Jlf-P^Jf^iw 
education and the same aifiount after placement However r^^^J^^ 
attained GEDs during their program participation. (See Chapter V 
for evidence that they are significantly more likely to attain 
SEDs in the longei: run.) 

70001 also places emphasis on the youth social izatloh pro- 
cess, a distinguishing feature not oAten *»^|«PV'r'||'|i„^"| 
training programs. Each local program is required to begin j 
SEVCA Chapter (70001 Career Association) which i| a cross between 
a social club and i service organization. Its aim is^to provicje 
beer support for young persons, cbhcbmitant ly increasing commun- 
il? and'^cfr^er awLeness. tocal SEVCA events mght ^^"9^ f^^^^f 
neighborhood cliin~up to a dance,! travei "^f.y^^^^^^^^ 
conktenees where youth participate n semr^r^ v«>^^^^^^^^ 
coffioetitions. It is difficult to calibrate SBVCA s contribution 
to youth eSpioy^ent, but it may offer considerable psycho-social 
^Spport during a difficult time of career and personal develop- 
5en?. Soaie staff have suggested that SEVCft offer rags ar^^ 
appealing to young women than to e>en, and this could contribute 
to 70001 's high female representation. 

eat line of the Report 

Chapter ii cbhtinues the discussion of research deiign 
issues. It presents the characteristics of the participant and 
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comparison groups^ the effects of attr it ibh and several issues 
related to modeiing, sueh as how to control for uhb^^ dif- 
ferences between the participant and comparison groups 

Chapter ill presents the results from the analysis inspecting 
the effects of the prbgrani oh labor market outcomes , including 
employment status, occupation, and earnings^ We examine these 
outcomes both at the point-ih-t ime of the 24 to 40-month post- 
intake follow-up interviews and for calendar year 1981. We also 
combine our 24 to 40-month foiiow-up data with two earlier waves 
of follow-up informatioh in order to estimate changes over time 
in prograrti effects. 

Chapter IV inspects two potential explanations for the 
effects found in Chapter III. It invest igates the possible 
effects of the recession on the labor market behavior of th^?se 
disadvantaged youth and the potential effects of ehildbearing. 
Chapter V considers the effects of the program^ on other outcomes • 
In Chapter VI,> we examine estimate^ of program costs and compare 
these costs to program benefits. Chapter VII reviews the major 
findings and makes policy recommendations. 



Notes 



X) A mote complete discussion of this issue can be found in 
the final report on pre-employment services. See (3) 
below. 

2) Public/Private Ventures. S econd fhterim geport i T|ie 
impact of Pte^e!npIoyment_— PxogrAms^ ofl Disadyantg|ed 
Youth: A _ Short Term Foll ow^ap Stgdj r . Fall 1981, 
pRTiadelphia^ Pennsylvania. 

3 5 Public/Private Ventures. The Impact of ^P re-employment 
Se- vices on the Eroplcyment^^aS i^E ajnincTS of Disa d\^antage43 
th i F i_hk 1 RepoVt , A pr i 1 1 9 8 f l Phiia-delphia , 

Pennsylvania* 
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eHAPTER II 



PARTlCIPftMT AMD COMPARISON SftMPtES 

The original sample for this ana lysij consists of 535 
participants and 440 coRiparison youth, the parti^cipants ate the 
entire population of youth whp enrolled in 700131 programs between 
January 1979 and April 1980 in the five directly-operated sites 
of Atlanta^ Bbstbhr Richmdndr San Antdnic&r and Tulsa, For 
purposes of this study ^ enrol ImeSt was defined as the point of 
intake into the jpjrograro, which usually represented a youth's 
second visit to the site. 

It is iroportaht to note that the 70001 programs that were 
chosen for fbllbw-up interviews {that is^ directly-operated pnes| 
performed better in short term outcome measures^ such as place- 
ment in unsubsidized jobs^^ than those 70001 programs hot chbff^n 
for follow-up Jsee the earlier report) This s^gg^sts that one 
must be cautious in general izing to all 70001 programs^ siSce 
analyses based on our foilqw-op sites may overstate the benefits 
to youth. On the other hand/ one must remember that we are 
investigating the long run effects on youth who entered these 
five 70001 programs during 1979 and early 1980; modifications in 
the program since then could alter the long run benefits to 
youth . 

It is also important to note that this study ulled a compari- 
son group rather than a control g^oup methodb The youth 
were not randomly assigned to participant and cbmparjsbjTi samples* 
Rather # efforts were mad^ to collect a comparison group of youth 
who were as similar as possible to participant youths both in 
terms of background characteristics and the date at which they 
applied for program assistance^ The cbtSpar isbn sample^ for the 
most part^ was matched youth for ybutb with the participant sam- 
ple according to city^ seX/ age^ race/etbhici ty and month of 
participant intake* Virtually all obropa^isbh ybutb were eco- 
nomically d isad van t aged r _ unemployed^ and higl^ ^ schbbl drbpbuts • 
They were drawn almost entirely from among registrants at local 
job service offices. Where this procedure failed to yield enough 
ybuthr additional coropar ison yc3^\ith were j^^lected from lists in 
CETA prime spbhsbr "hbt enrol Lg3'* files at>d from dropout lists 
from schools and cbmmunitj,r^^&e^ brgahizatibris^ JNbte that this 
latter procedure could ihtroduc^^ a slight bias in favor of the 
program*) Table II-l contrasts the part comparison 
samples on selected background characteristics at the baseline 
interview. Few statistically significant differences^ appear* 
(Tables for background characteristics of male and female 
participant and comparison samples are shown in Appendix fables 
A-II-1 and A-II-2.J 

In the rg-^bhth post-intake follow-up, 303 participants and 
346 comparison's were interviewed for a completion rate of 66%* 
In the *14**-S^nti5 post-intake fbl low-up^ 246 participants and 264 
comparisons were interviewed for a cbaipletibh rate of 52%- It 
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TABLE II-l 
'h a r a c t er i s t i csstjnt*^ 



Participant 



ibn Groups 



Participants Coraparisbhs 
n» 535 n* 440 



Average ^ge 

Sex 

male 
female 

Ethnicity 

white 
black 
Hispanic 

High school degree 

Average reading score 
(grade level) 

Average number 
of depehdenfes 

Head of household 

Family of one 

Member of family 

Receiving AFbG 

Ever held pre-progratn job 

Average pte-prograro wage 

Atlanta 
Boston 
Richmond 
San Ahtbhib 
tuisa 



17.9 



41% 
59% 



18% 
62% 
20% 

1% 

6.8 

.34 

12% 
111 
77% 
20% 
71% 

19% 
19% 
21% 
25% 
171 



18*2 



40% 



14% 
63% 
23% 

1% 
6.g 



.50 

13% 

10% 

77% 

15%* 

75% 

$2.30* 

23% 
15% 
19% 
20% « 

2^2% 



*Ihdicates difference between groups teaches statistical 
significance at the .05 level * 



10 

23 



should be rtdted that, in the ••i4"-inonth foUow-ap^ an effor^ was 
inade tc track gnf y those sample Vduth wtib had bsen rntet viewed in 
the "9*'-rtionth follow-up; However^ in fciie 24 to 43-month follow- 
UD, an effort was made to reach ali 9V5 youth in the originsl 
baiselihe survey, regardless of whether they had been IHterviewed 
at an earlier stage. The Institute for Survey Research at Temple 
University was awarded the sub-contract to conduct Efii^se ihter« 
viewsi ISR reached 451 of 535 participants and 392 of «40^compa- 
risoh yduth^ for ah overall survey completion rate of BSli 

Statistical tests were conducted to test for possible ^^tnple 
-ttfition bias. Table Ii-2 compares the baseline ctsaractecietics 
for attriters and those foliowed-up at 24 t6 40 rrt6TitF?5« {tables 
for males and females separately appear in the Appindi^ as Tables 
h-ll-i and A-II-4.) fis is clear in th<? tables, altrjtJbrt aoes 
not appear to affect the participant and coHi^arison groups diffe- 
rentially, 

controlling for Sele ction Bi as 

As is clear in T&ble 1 1-1, there are soie diffelrences between 
the participant and comparisop samples in i-'haracteristica such as 
age and number of dependents. Differences between the comparvsoft 
and participant groups cause no problem ai long as all fche_dif- 
ferencesi between the groups are observable. The pwrpdse of |he 
tnuitivariate analyses in the fol losing crhapter is to ebnttbl Sdt 
differences in observable character ist ics jsuch as age^ race/efch- 
nicity, number of dependents* and high school d^ree. However, 
in nott-randamly chosen saro^ples such as these, there is the possi- 
bility that both seif-seiectioti and program gelection procedures 
could result in unobserved differenGes between the participant 
and coinparisoh samples. One is only concerned abouj: uhobservable 
differehces that would affect outcotneSe such as motiv^ation and 
self-initiative. Theoretically, the potei^tlal biases introduced 
by such unobserved differehces could operate in either direction^ 
that is, in favor of or against the program^. Mors atotiNfated 
youth may be attracted to 7ff01 tn on the otHer hand, youth wj.th 
more self-initiative may feel they can do better m their own. 

In an attempt to take into acCmiMt soch uhbbserved differ- 
ehces between the participant atsd. coitipan i son groups* w 
recehtly developed ecommettic procedure which cbhtrbls for 
selection bias iii the estitsatiefs of program effects ^ This 
procedure invbjye;^ a two stage methodology which attempts to 
capture unobsecvabls character istits which affected selection 
into the program, m the first stage of this analysis^ selfctjoa 
into the prograni is modeled based on varieus ©bsetvaSsle differ- 
ences between sample individuals. From this rondel* coMiti<>hal 
probabili^-ies of participation based oJi obs«rviabie characteris- 
tics are estimated for each individtial. Differences between the 
predicted and actual participation status of each individual can 
then be attrib'ited to uhobservabl^e individual character jstics. 
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TABLE ii-2 



ftttrition in 24 to M-Hwtjj^£ojJ^w-ap Sg^nple 
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Average age 

Sex 
waif 
female 



Participants Com parisans . 

Followed- Attriters Followed- ftttriters 

dp up 

n=451 n»84 n=392 n»48 

i7.9** 17.9 18.2 is. 4 



401 46% 39% 46% 

60% 54% 61% 54% 



Ethnicity - 

white 13% 24% 16% 22% 

black 63% 57% 63% 63% 

Hispanic 24% 19% 21% 15% 

High school degree 1% 1% 1* ®* 

6.8 6.7 6.6 7.1 



Average reading 
score 



Average number ^_ . 

of dependents .34** .31 .48 .6J 

Head of household 12% 11% 

Member of family 78% 74% 78% 65% 

• 

Family of one 10% 15% 8% 25% 

Receiving AFDe 21% 12% 24% 22% 

Ever held — 

pre-program job 69% 74% 74% 83% 

Average pre- to -s-s* 

program wage $2.04** $2.19 $2.25 $2.72 

Atlanta iarnple 18% 20% ' 22% M| 

Boston sample 18% 23% 14% 23% 

Ricfimona^^mple 23% 26% 21% 

San Antonio sample 26% 17% 21% 13% 

Tulsa sample 15% 26% 22% 21% 



*lhaicate5 difference between attriters and those followed-up 
reaches statistical significance at the .05 level. 



Indicates difference between participants and comparisons at 
foilow-op reaches significance at the .05 level. 
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In the secdnd stage of this analysis, program effects on outcome 
measures are estimated, coritrbliing for dbservabie differences as 
well as ah additiohal variable^ lambda^ represent ihg the uribbser- 
vabie characteristics which affect program partieipatibh ^ 

Table 11^3 presents the results of the model predict ihg 
selection into the program., (Results of selection models run se- 
parately fbr the male and female samples appear in Appendix 
tables A-ii-5 and A-lI-5,) To make these models work, the selec- 
tion equation must: be distinguished frbin the. outcome equatiphs* 
To do this^ an additional variable must be added tb the selection 
equation^ which is related to selection into the prbgram but not 
to any of the outcome measures^ The variables vised tb identify 
the selection equation include whether or not the ybu^th was 
emplojred at the time of the baseline interview and the season of 
the year in which intake into the participant or comparison group 
tbbk place. Because we cbritrbl for pre-program labor market 
experience in our outcome models^ it could be argued that employ- 
ment status at the point of the baseline interview should affect 
program participation but not labor market outcomes two and three 
years later. Similarly , season of intake should affect program 
participatibh^ but hot subsequent labor market outcomes. 

The results in Table 11-3 suggest that the selection model 
does a fairly good job of predicting part icipatipn in the pro- 
gram^ The overall model is statistically sighi f icaht and the 
identifying variables of employment status at ihtaJ^e and quarter 
of intake both have statistically sighificaht effects. Other 
variables which are signifi^cant in the equatibhs include 
neighborhood at intake and educational attainment * For both male 
and female gimples, comparisons tend to have more education than 
participants* In the female selection equation, comparisons tend 
to have significantly mbre dependents. 



Random assignment to participant and c^Dmp^^^ 
riot used. Nonetheless, participant and comparison group samples 
are quite similar, in part as a result of the aiatching procedure 
utilized. Sample attritibh has not biased the sainples for analy- 
sis. While there may be mihbr observable differences between the 
participaht and cbjiiparisbh grbups, there may be unobserved 
differences as well due tb the. fact that there was no random 
assignment to the par ti^cipaht and cbmp^^ grbups. Because of 

these possible differences, a correction pi^ocedure will be used 
in the multivariate models to control for^ unobserved as well as 
observed differences between the two groups. It should be noted 
that this Cbrrectibh procedure controls for some but not all of 
the unobserved differences between participant and comparison 
youth. 
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TABLE II-3 



Estimates of Selectioti^^Jt^Q 78001 Pro^tam 



ebef f icient 



Age at intake 
Ethnicity 

black 

Hispanic 

Sex 

male 
Education le^el 
Head of household 

Family of one 

Number of dependents 

Intake in winter 

Intake in spring 

Intake in fall 

Unemployment rate 

Ever held pre-prbgram job 

Employed at intake 

Atlanta 

Boston 

Richmond 

San ftntbhib 

Atlanta neighborhood 

Boston neighbbrhbbd 

Richmond neighbor hood 

San Antonio neighborhood 

Tulsa neighbbrhbbd 

Constant 



007 


— . Z X 


-•09 


— * J ^ 


-.37 


— X • Z O 


-.13 


— X.I/ 


-.59 


— . O D 


.22 


X . 20 


.05 


.ZD 


-.27 


— Z . 






-.41 


-2.88* 


.07 


.47 


-.13 


-1.32 


.19 


1.56 


-1.20 


-6.34* 


1.03 


2.28* 


1.03 


2.78* 


,55 


2.18* 


1.44 


3.33* 


.33 


1.61 


.50 


1.96* 


.23 


1.05 


-.31 


-1.37 


1.37 


4.57* 


2.14 


3.17* 



Sample size » 814 - _^ 

Proportion of participants m sample - 531^_ 
Chi-square with 23 degrees of freedom - 260 

•indicates statistical significance at the .05 level » 
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See ISR's final report to Public/Private Ventures for 
detailed response rates by city,r sex^ and participant/^ 
comparison group* In no city wa3 the response ratefpr 
eitlher the participant or comparison group below 70%; 
93% of the interviews were conducted in person. 
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CHAPTER iii 



PROGRAM IMPACTS 

The key question that this last phase of the investiga 
the effects of pre--espio^ent prograses S3S designed to answer was 
WhJther"70001 prog ram'^ef fee ts persist in the long run or whether 
they decay as rapidly as did the effects of JFY. This chapter 
presents the results of the econometric analysis of prograni 
impacts. Alternative explanations for th> effects and empirical 
tests of them appear in the following chapters i 

Table iii-i presents mean earnings for all mCTbers of the 
sample regardless of whether they were employed , by participant 
group status and by sex, at each of the three follow-up wayesi 
Inspection of this table suggests that at the first two waves, 
particigants significantly outperformed cbmparison group roerobers 
in weekly earnings. (Mote, however, that this is not the case 
for females.) However, in the last wave ^ wh«ih comparing the 
sample aggregated by sex, participant and comparison group 
members do equally well. Participants had been increasing their 
earnings from the first to the second wave, but this rate of 
increase tapered off between the second and Jiiird waves^ at ^ a 
time when the comparison group experienced a marked increase ih 
their average earhings* Ah inspection of these means by sex 
indicates that male participants are still outperforming their 
comparison group counterparts (but only slightly! whereas the 
female cbmparisOr group has slightly surpassed the female 
participants at the 24 to 40-month follow-up. 

After various specifications in the multivariate analyses of 
the 24 to 40-m6nth follow-up data, we found some evidence that 
the 70001 effects decay over time^ inspection of the means sug- 
gests that the *decay" results firbm the fact that coraparisqn 
group members are doing increasingly better over time while par- 
ticipants ace experiencing some slippage ih their employtfient rate 
and earnings. 

For the total sample, there is some empirical evidence th§t 
program effects go from being positive and statistically signifi- 
cant in the earliest time period to slightly negative in the 
final follow-up period. For females, the program effects becomes 
negative and statistically significant in the latter time period. 
For mali&s* the program effect remains positive* but it is not 
statistically significant. 

In this chapter, we explain how these estimates were 
obtaihedi The analysis is divided into three parts — prograro 
effects at the point- ih-time of the 24 to 40-roonth follow-up, 
program effects from calendar year 1981, and program effects over 
time using data from all three of the follow-up samples. 
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TABLE III-l 



Hean Eagfiiqgs at E< 

Participant Group St^ 



Wavei by 



"ai^bh th' 



"14"-Mdnth* 



24 



4a^M6hth 



Total 

Participants 
Comparisons 

Males 

Participants 
Comparisons 

Females 

Participants 
Comparisons 



$46.42 
34.45 



$69.22* 
46.23 



$32.90 
27.21 



$59.24 
39.18 



$90.74* 
4^.25 



S41.99 
33.18 



$62.23 
63,32 



$101.18 
93.38 



$37.04 
44.16 



♦indicates that the difference between participant and 
comparison group values reach€fs statistical significance at tne 
.05 level. 

^These numbers may vary slightly from earlier reports because 
the saihplcfs differ somewhat. 



Program Impacts in May ^hd June of 1982 (The^i 

In this section the prograro^s net effects at the point-in- 
time of the third wave follow-up interviews are estimated. fts 
noted earlier, these interviews all took place in Hay and^ June of 
1982, and varied from 24 to 40 months since the time of^ in^ta?e 
into the 70001 program. Outcome measures considered^^include 
employment status, weekly earnings, and occupational skill level. 
In a later chapter, we eximine the effects of participation in 
the 70001 program on noh-ecohbmic dutcdroes. 

Table III-2 lists average wag^s, hdurs wdrked per week^ 
weekly earnings, and iikelihdod of being eihpldyed fdr the aggre- 
gated sample and by sex, of the participant and comparison 
samples at the time of the 24 to 40-month follbw-up survey. 
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TABLE 11 1-2 



Labor Market Outcomes at 24 to 40^M5nth Follo«^ufi , 
by Participant Group S^^itus and Sex 



Participants Comparisons 

aggregated SampXa 



Likelihood of _ 

being «tipl6yea .38 •42 

Mean Wages of _ 

those working $4^18 $4,14 
tfeekly hours of 

those working 37 36 
Weekly earnings including 

zero earners $62.23 $63w32 

n 451 392 

Males 



Likelihood of 

being «nplbyed .53 ^49 

Mean wage of _ _ 

those working $4^55 $4.54 

Weekly hours of 

those working _ 40 38 
Weekly earnings ihclt^ihg __ 

zero earners $101.78 $93.78 

n i79 154 



Females 

Likelihood of 

being empljpyed .29 •37* 

Mean wage of __ __ _ _ 

those working $3.73 $3.74 

Weekly hours of 

those working 34 35 

Weekly earnings including 

zero earners $37.04 $44^16 

n 272 238 



♦Indicates statistical significance at the .05 level. 
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As the table indicates* participant males are doing slightly 
better in the labor marRet than cbinparison tfalesi while narticx- 
pant feSales are dbihg somewhat worse than c<OTpart son females^ 
None ol these differences, however, are st_atj_st_i5ally .s^?"^f^J^^' 
with the exception that cbinparison group females are more ixKeiy 
to be employed than participant females. 

To sepiirate out program effects, mul-tivariate models for 
Weekly earnings and employment status were estimated. These 
models were estimated for the total sample and also separately 
for 'aales and females. Hbdels were estimated separately for each 
sex becaase the determinants bf earnings are quite different Jand 
program impacts diverge)^ for the two sexes, as many of these 
young wbmen begin their chiidbearing during this follow-up 
piriod. The paVterns that appear in Table V ^t^^^^^^f 
ample justification for the inspection of models estimated 
separately by sex. 

individual characteristics which were held cbhstant Jnclu|ed 
aqe, edocatibhal status at intake, race, Hispanic ethnicity, 
whether or not the individual had ever held a job before t^e 
program, nuSber of dependents at intake^ whether o"^^ the 
individual was a head bf hbusehbld or a member of a family^ at 
intake, as well as whether the individual lived in Atlanta, 
Bostbrt, Richmond, San Antonio, br TUlsa. The lambda variable^in 
these models reflects the attempt tb control for selection bias 
using the results of the participatibn eqUatibn described m tne 
previous chapter. 

some could argue that merely inspecting the effects o_n_e^^ 
pibyment and earnings is not sufficient for the youth popultion. 
Who during this transitional time may choose to return to school. 
(Therefbre, analyses on schbblihg butcbmes ^PP®^^. ^" ^AP^®^^,',*^ 
The fear is that higher proportions of ybuth in school could 
lelulfcTn evidence of lower earnings in the short-run, b«t higher 
earnings in the longer run, InspecHon of the schoo^Hng 
saqqest that the program has significantly increased the l»keli- 
hoofof completion of a GEO since intake, but differences between 
participants and comparison grbups on current enrol Im^ 
Who list education or training as their major aFtl^ity are at the 
24-40 month follow-up quite small. Thi s suggests that our 
decision to analyse the data this way «and the rejection of 
alternative, arid yet more troublesome methods) has probably not 
seriously biased the firidirigs. 



Cbritrolling for education and training since y^ake is 
problematic because this may have been a result of V^oq^ 
participatibn (arid therefore is notexogeribuslri the outcome 
equation. Estimating models separately for those 
those not Iri school is equally problematic. We are unable to 
contlolfor differential solution into thbsa two ^groups through 
use of the technique because no instrument was available. 
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Tables Illr3 to Ili-5: present the results j)f the earnings 
models. Appendix Tables A-lii-l and_ft-III-2 report the results 
of the probability of <OTplbymeht models. 

ks is clear in these tables ^ we have found no evidence that 
the program has a positive effect oh earnings at the 24 to 40- 
lapnth follow-up. For the combined sample^ the model^s ^uggest 
that the program effect is near zero and statistically insignifi- 
cant; for males, the models snggest that the program effect is 
positive but not statistical v significant; for females.^ the 
models suggest the program ef. t is negativ3 and statistically 
sighi f icaht • 

The earnings models also were estimated, both without the 
correction for selection bias and with five additional variables 
to take into account the fact that participants and comparisons 
were differentially geographically distributed Within the five 
citiesi The cbhclusibhs made ^bbut the decay of prog ram effects 
are not sensitive to whether we control for selection bias* 
Omitting the correction for selection bias does not change the 
program effect for the total Sample^ but it evens out somewhat 
the difference between program^ impacts bh males and females 

(although the effect for females is still negative and 

statistically significant) . Adding the five neighborhood 
variables lowers the program effect for all three samples* The 
results of models withj)ut the correction for selection bias are 
presented in Appendix Tables A-IIi-3 and A-Ill-4* 

Of the other explanatory variables in these raod els, i 
bit surprising that education has no effect for males and is 
negative and statistically significant for fetaales. However, it 
should be kept in mind that all of the youth in the sample are 
high school dropouts. For males, there may hbt be that much 
difference between leaving school after 9th * 10th or 11th grade? 
For females^ the negative education effect may be due tb the fact 
that women whb left school ear ly to have children^ how have 
children bid enough tb permit are-entrance to the. labor market. 
The effect of robst of the other explanatory variables are a* 
expected • 

We also investigated whether there w?is evidence that for 
certain subgroups of the participants^ the program stjll had 
positive and statistically sighi fijraht effects at_the__24 to 
40-rhbhth period. Comparisons were made for tSbse of different 
racial/ethhic groups (white/black/His^nic) and par ticipanti?. of 
different ages (under 18 at intake versus 18 years of age ttr.t5 
older). In hone of these grbups could there be found empirivt^l 
evidence for statistically significant posit eft^ctn 
on employment and earnings in the 24-40 month periods 
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TABLE II 1-3 



justed Tobit Estiiaates of^ the Bet ermioants . _ 
Earnings at 24 to 40-Honth^'ollo3feaap^ Total Sample 



InSependeht 5^^^!^^? .a ^^^^i^ 



Age at Follow-ap A -g 99* 

Race {Blaclc = 1) Z^^-ft IjI* 

Ethnicity (Hispanic = 1) -41.19 -o.^o 



S« (Hale vl) '!ir 
Education at intake -2.06 
Head of household 

at intake 
Net living with family 
at intake 



-7.32 -1.34 

14.68 2.91* 
3.07 1.0? 



Dependents at intake 3. a/ 

Ever held pre-program job 10.76 ^-^o 



Atlanta 
Boston 
Rictrabhd 
San Ahtbhib 
Larobda (Go t recti bh 
variable) 



-9.95 -1.85 

-1.43 -0-27 

-21.79 -4.05* 

14.41 1-86 

3.56 .62 

-7.02 -.7? 



Participation as 
Constant ^-02 



Sample size * 828 

Mean Weekly earnings » $62.72 

Ptbpbrtibn with positive earnings 
Sigma » 39^78 



40 



^rhe tbbit coefficients have been adjusted by the proportion 
in the sample with positive earnings. 

•Indicates statistical significance at the .05 level. 
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TftBtE iii-4 



Adjusted Tobit Estiasateg of the- P^t^g qi.nawt& 
of ^ekly Earnings at 24 to 40-Month fqIfojg~up> 5aaes 



Independent 
variabies 

Age at Follow-up 
Race (Black = I) 
Ethnicity (Hispanic = ij 
Education at intake 
Head of household 

at intake 

Not living with family 

at intake 
Dependents at intake 
Ever held pre-prbgram job 
Atlanta 
Boston • 
Ricl^ond 

San Antonio 

Laiitbda (Correction 

variable) 
Participation 
Constant 

Sample size » 324 
Mean weekly earnings « §97*22 
Proportion with positive earnings 
Sigitsa « 96.09 



-41,36 
-48,38 

-5S,73 

19,89 
28,^8 
-8,56 
17*56 
-42,46 
59,18 

-1!>,68 
31,39 
76,12 



.54 



t-ratib 

-.92 
-2,07* 
-i90 
.09 

-1 .48 

1.42 
.90 
1.91 
-.39 
.71 
-2.40* 
.91 

-.84 
.84 
-.93 



^Here^ method of tnomehts techCTigue is used to derive the tobit 
coefficients ass the Fletcher Powell prbceduire tjid not converge. 
It should be noted that the Fletcher Povre 11 toytine produces more 
statistically significant effects than the iti^thod ot moments, a 
less efficient rootines 

''The tobit coefficients have been adjuat^d by the prbpbttibn 
in the sample with positive earnings i 



♦Indicates statistical significance at the i05 level. 
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TABILE III-5 



Adiasted Tbbit E s timatas^ of t h e D eteriBina hts of Wee 
— i — ^^-^^ ^^-.i^w ^?«l^^««_Mr^ Females 



at 24 to 46^ 



independent 
Variables 

Age at Foilow-up 
Race (Blacky 1) _ 
Ethnicity (Hispanic = 1) 
Education at intake 
Head of household 

at intake ^ 

Not living with family 

at intake 
Dependents at intake 
Ever held pre-prograw job 
Atlanta 
Boston 
Richmond 

San Antonio 

Lambda (Correction 

variable) 
Participation 
Constant 

Sample size « 504 _ 

Mean weekly earnings * $40.54 
proportion with positive earnings 
Sigma « 19.53 



Adjusted 

Coefficient 


t-ratib 


.51 
-37.69 
-46.19 
-5.03 


.54 
-8.03* 
-6.63* 
-2.40* 


2.23 


.53 


5.00 
-4.90 

8.61 
13.38 
-3.85 
-11.91 

2.50 


.89 
-2.05* 
2.86* 
-2.78* 

-.73 
-2.37* 
.37 


18.23 
-31.65 
55.78 


3.46* 
-3.83* 
2.59* 



.32 



*fhe tbbit coefficients have Been adjusted by the proportion 
in the sample with positi\re earnings. 

•Indicates statistical significance at the .05 level. 
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We also examined the occupatiohai skiU distribation of the 
participant and compar isori samples at 24 to 40-.months after- 
-intake. Occapations from the survey were cddetJ into three-digit 
census classifications and then ranked by their Specific Voca- 
tional Preparation (SVPj scores the SVP index consist^ of nine 
levels, denoting the time it takes to becotne prof ic lent at an 
dccupatibh once prerequisite education has been completed. The 
scale varies fran level 1 (short demonstration only) to level 9 
(over 10 years) i Here^ a skilled occupation w^s defined as one 
requiring at least six months tb learn properly (SVP level 5 and 
above). Examples of occupatfans classified as skilled under this 
definition include carpenters^ machinists^ mechanics, and appren- 
tices in the construction trades. Examples of occupations class- 
ified as unskilled include del iverymen, health aides, laborers, 
and operatives. Table III-S lists the percentages of the 
employed comparison and participant samples who were in skilled 
occupations at the time of their third wave interview^ 

TABLE I I 1-6 




L-\xpi by Sex 
Participants eo ^ariso hs 

Males 25% 21% 

n 100 82 

Females 51 19%* 

n 80 81 



•Indicates that difference between participants and comparisons 
reaches statistical significance at the .05 level. 

Table III-6 indicates that male participants in 70001 
not trore likely than male comparison individuals to hold skilled 
jobs at the 24 to 40-wbhth fbllbw-up. However^ comparison group 
females who were eroplbyed were significantly- more likely to be 
found in skilled Jobs than participant females. K tnultivariate 
model was estimated to explain eraplbyroent in skilled occupations i 
From these laultivarAate analyses* we found no evidence that 
program participation significantly improved the chances of 
youth's moving into skilled occupations. 

these results are not surprising as moat of the youth in the 
sample are employed in Ibw-skilled occupations. For both part ir 
cipant and compar i son males* «bst cotrBnonly held jobs included 
janitors, food service workers^ short-order cooks, del iverymen^ 
gardeners, and security guards. For participant and comparison 
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fesBaies, most freqaeritly held Jobs included food service workers* 
cashiers, riurse's aides^ cleaners and janitor. j and office/cler- 
ical Workers. Occuoational distributions* by participant group 
status and by g^7x, are presented in Appendix tables A-I.I-5 and 
ft-lii-6; 

Proqramu4giparts nHfiiig the 1981 Calendar Year 

in thF third wave follbw-up interviews, besides obtaining 
irtfortnatiDtri on current labor market status and earnings, ques- 
tions wec# also asked regarding employineht and earnings for cat- 
ehdar year T^Bl. As participants entered the prog^ram sometime 
between January 1579 and April 1980, calendar year 1981 ^r^epresen- 
ted a period that for the most part ranged between 12 and 33 
months since intakci 

We were interested iS inspecting calendar year earnings 
because at each previous wave of fbllbw-up, we had on ly^ obtained 
information On weekly earnings and were* therefore, Jo*ced to 
make assuiptiohs about how these translated into annual earnings 
qains. We therefore collected data on annual earnings in nope| 
of obtaiSihg more ih-depth estimates of program^ impacts. A 
caveat is appropriate here, however. Since caiendar Vfa^^^'J 
was between 12 and 33 months after intake, analyses of annual 
earnings win not be directly comparable to any of the wave- by- 
wave analyses. In fact, the effects might be expected to be 
somewhere between those found in the second and third waves. 

table III-7 lists averages for yearly earnings, vreeks worked 
full-time, and weeks worked part time, by sex, for the partici- 
pant and comparisbri samples as reported for 1981* 

AS is evident in the table* both participant males and fe- 
males did better than their respective comparison groups durm-^ 
1981 than they did in May and June of 1982. While most of th^se 
differences are hot statistically significant* male participants 
worked substantially more full-time weeks in 1981 than did com- 
parison males. (Nbte that P^^icipant relative to comparis^ 
group ones may be slightly underestimated due to differential 
school enroilroeht*) 

We attempted to separate but program effects on these Ubbr 
market outcomes through the use bf multivariate analysis| We 
found hb evidence that program participation Jhad a^ significant 
effect on 1981 earnings or weeks worked fall-time for males or 
femalesi 

We also examined program effects on the skill level of the 
job held longest during 1981. Table 111^8 lists the e«f««"tages 
of employed participants and cbmparisbhs* g 
occupations at their longest held jobs in 1981. Table III-8 
suggests that participants '*ere not more likely than comparisons 
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tftBEB iIt-7 



LaboE Eocce Outcomes Reported jfor galehdar Year 1981> 
by Participant Group StatLHs and Sex 



Pari 



Comparisons 



M ale s 



Mean yearly 

earnings 
Mean weeks 

wbrlcea full-time 
Mean weeks 

worked part-time 



$4,486 
27.0* 
5.0 

179 



$3,891 
19.9 
4.8 

154 



Feaiales 



Mean yearly 

earnings 
Mean weeks 

worked full-time 
Mean weeks 

worked part-time 

h 



$1,813 
13.3 
3.3 
272 



$1,147 
12.3 
3.5 

238 



♦Indicates statistical significance at the .(35 level 



TftBtE II 1-8 



Ltages of Employed Participants and Comparison 

" Qcc apaj^iona in the Job Held Longest During 1^81 



Males 
h 

Females 
h 



21% 
132 

10% 
131 



Comparisons 

22% 
181 

17% 
94 
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to be employed in skilled jobs in 198li Jio evidence was found 
that the p^5gram had a statistically significant impact on occu- 
pational attainment daring calendar year 1981. 

thus, we have found no evidence that participation in tfie 
70001 program had a statistically significant impact on earnings 
or employSent 24 to 40 months after entry into the program or on 
earnings and emplopeht during calendar year 1981, some 12 to 33 
months subsequent to entry to the program. 

Program Effects bvi 



In this section, we uie dati from the three follow-up waves 
to estimate changes in program effects over time, "® 
three waves of data, follow-up observations range from_ 7 to 40- 
months since intafee. The spread is fairly evenly distributed 
throughout the entire range. TO test for changes in program _ ef- 
fects over time, the Sonths-sihce-intalce variable was broken into 
intervals of six months eachi 

Table III-9 summarizes the changes over time in f'^^^rain ef- 
fects on weekly earnings. There is "S^^t^^^^^^?^,^?^^^^^ 
effects over time in a pooled data set when the distribution of 
thf dependent variable ^requires maxima . Hkelihood .Jstimation 
techniques. For this reason, estimates using alternative techni- 
quSs are presented. (Appendix B explains how these estimates 
^ere deriv^ and the limitations of each. 3 Table IIi-9 assesses 
the sensitivity of the estimates and conclusions to two factors, 
the inclusion of lambda a Correction for unobserved differences 
between the participant and comparison groups), and whether the 
data are pooled or estimated vrave by wave. We i>refer estimates 
corrected for selection bias,- but we have no preferred estimation 
technique between the pooled and the wave-by-wave, since the 
pooled estimates are uncorrected for correlations of errors 
across observations associated with the same individuals. 

While the estimates CI actuate considerably , most of the 
conclusions drawn from them do not seem to be very sensitive to 
the estimation procedure. They are as follows: 



When considering the sample aggregated by^ sex,, pro^ 
participation appears to have a statistically significant 
positive effect on participants in the early post-program 
periods, but then the effect becomes negative, but not 
statistically significant* Thus there is evidence that 
the overall program effect exists but decays. 



For males, there is evidence that: the program Has a 




nd negative in some model specifications in certain 
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Adjusted Estitiiates of the Net Effects of the^t ^ 



TABLE 

he Net Effec 

on Earnings by Months Since Intake and Sex^ 

7-12 13-18 19-23 24-29 30-35 36-40 



Hales 



Wave by wave (corrected 

for selection bias) 24 52 22 29 39 13 

Pooled (corrected for 

selection biasj 27* 42** 30* 32* 21 9 

Wave by wave jndt corrected _ 

for selection bias) 16 53** 22 --2 11 -15 



Pooled (not corrected 

for selection bias) 22** 36** 25** 26* 16** -14 



Wave by wave (corrected 

for selection bias) 7 -27** -30** -30** -43** 19* 



Pooled (corrected for 

selection bias) ~9* -5 -9 -20** -24** -11* 

Wave by wave (hot corrected 

for selection bias) 6 10** 7 -2 -14** 12** 

Pooled (not corrected 

for selection bias) 5* 9** 5 -5 -9** 4 

wave by wave (corrected 

for selection bias) IS** 13 2 -7 -12 -8 

Wave by wave (hot corrected 

for selection bias) 10»* 29** 16»* 1 -5 -.4 

♦indicates statistical significance at the 
•i0 level. 

**Ihdicates statistical significance at the .05 level. 

^Appendix B describes how these estimates were obtained. 
ebefficiehts have been adjusted by the proportior about the liinit, 

^Nbte that the pooled models could hot be estimated for the 
total data set. 
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titne periods. Thai, there is evidence ^ "'^^^ 

exists in the early p5it-prbi3ram period and then decays. 

o For females, there is evidence that the ,^^5^^^ ^|*^| 
and statistically significant in the later post-pcogram 

periods. 

The estimates of the effecti for females in the early Pojt- 
prlgram peHods are sensitive to the estimation procedures used. 

Thas while the estimates during the latter three ^time 
peribSl'are ho't sensitive to . the_ type « ^^J""" "'fS'" il 
used sbitie of the earlier estimates are. Nevertheless, tnere is 
evidenll of a d^cay of program effects at 24 to 40 months after 
program intake^ 

Siiromary 

In this chapter we inspected program effects at the_ time of 
the 24 to 40-molth follo.-up, for calendar year ^^1^'^-^ 7 ound 
entire 7 to 40-mohth fOllOw^up period. For ^"'^ ^,1tv 
evidlnce that the program effects were P°sjj:ive but statisticaU| 
ihiidnificant- in the 24 to 40-month post-program period. We 
fSunI a&i1:fon^ that P^?^^^ ^^^^^^^ 

negative and statistically significant for females^ ?"Lt ™ple 
neqative but not statistically significant for the ^totalsamplj 
ar?he 24 to 40-month follow-up. For calendar year 1981, prof lar, 
iffects were insignificant for all three groups. ^^^^^^^,.1^1% 
40!|Inth follow-up period, there is evidence that P^f^^"^ 
were f©ttnd to have decayed for all three s^an^Plff - Jhe f f feet _ tor 
n^l^B remains positive but is not close ^^aVstical sigm^^ 
cance. No siQnificant differences m occupational attainment 
Se?e found betwe*.n the participant and comparison groups eith- 
er It the time of the 24 to 40-month fOllo«-up ^^'^^^^.^^^-Pf.^^"^" 
year 1981. three i*p^rtant factors must be kept injnind when 
coniidering these results. First, the programs selected fo| fo^- 

dTfflrentiaV enrollnfent in ^ucational training programs e« 
thil! ?Ssilts in an unknown fashion. (This latter possibility is 
investigated in Chapter V.} 

The next chapter investigates possible exp^lanations for the 
decay of program effects. First, potential effects of the 
t^llsion are' inspected and then differential ch^ldl^earing by 
participants and comparison group females is assessed. 



GHAPTER IV 



ftSSESSMENf OF ftLtERNftTlVE EXPLANATIONS 



in Chapter III, we found eviaence that the effects oi the 
70001 program had decayed over time. One possiBle explanation, is 
that the latest observations were obtained i^n the middle of a 
deep recession^ which hit youth and inner cities particularly 
hard. In this chapter* we attempt to disentangle the impacts of 
the recession on the estimates of program effects. Further, the 
program has negative effects on females in the logger run post 
program periods. This is a bit surprising. Therefore, this 
chapter attempts to make sense of this finding by ascertaining 
whether differential childbearing by participant and cbmparisbh 
females has produced the negative program impact for females* 
After the assessment of alternative explanations, the summary of 
the chapter concludes the analysis of post-program impacts. 



One concern is that the 24 to 40-month fbllow-up interviews 
took place in May and June of 1982 in the midst of a deep 
recession. The comparison group methodology should take caie of 
this problem since participant and comparison y6ut»^ should be 
similarly affected by the economic downturn. However, a case 
could be made that the participant and comparison groups were 
differentially affected by the recession: the participant group 
could have moved into better paying and higher skilled jobs if it 
were hot for the bad economic tiroes; or the participant group 
went into the recessibh with higher employment rates and thUs had 
more to lose. We attempt through a number of different approach- 
es to disehtahgle program decay effects from the effects of a 
recessionary econbmyi 

The mbst straightf brward approach to trying to separate but 
recessionary effects is simply to look at the patterns of 
employment changes that have bccurred in tjie participant and 
comparison samples, table iV-i breaks down mean earnings at each 
of the follow-up waves into wage and emplbymeht cbmpOrients. 

When the effects of a program "decay," it can result from 
comparison group gains over time, deterioration in gains of 
participants, or both. If the recessibh was largely responsible 
fbr the decay of program eff ects , we would expect to ^ see 1 ittle 
improvement by comparison group meaebers and a deterioration _ of 
the participant atoup position. the patterns exhibited in Table 
IV-l make it difficult to accept a simple recessionacy effect 
explanation for the decay of program effects. Participants do 
suffer emplbymeht Ibsses between the second and thi^rd follow-up 
waves, but a large part of the decay of program effects is due to 
comparison gains rather than participant losses, the patterns in 
Table_ ly-l db not appears to suggest recessionary effects* but 
rather decay bf program effect. 
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TABLE IV-1 



Pro^port^ion Empioyea aha Heah Wage Rates . _ 

at Each Follow-up Wave , by Par tic jtpaniL Group Status and Si^K 



Prbpbrtibn Emplos^ed 
"S^'iontB" 



Follow-up wave 



Males 

Participants 
Comparisons 

Females 

Participants 
Coinpar isons 

Total 

Participants 
CoRiparisbhs 



.55* 
.37 



.32 
.25 



.41* 
.29 



.60* 
.43 



.33 
.31 



.43 
.36 



.53 
.49 



.29* 
.37 



.38 
.42 



Wa4e Rates for Those Who ftre E mployed 



Hales 



Participants $3.60 $4.04 $4.55 

ebroparisbns $3.60 $3.64 $4.54 



Fecoales 



Participants $3.20 $3-5? $3.73 

comparisons $3.45 $3.53 $3.74 



Tbtal 



Participants $3.40 $3.81 |4.J8 

Comparisons $3.52 $3.57 $4.14 



* Indicates difference between participants and comparison 
grbup reaches significance at the i05 level. 

^these huaibers may vary slightly froi those in earlier 
reports because the samples differ slightly. 
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ft second fairly simple test for possible recessionary effects 
is to concentrate on particular follow-up waves im lobltirig. for 
program decay. The 24 to 40-month follow-up wave took place 
entirely in May and June of 1982 in the middle of a recession i 
The "14" mbrith fbllbw-up wave had a mean of l5 months since 
intake, but spanned a period of 7 tj> 29 months since intake . 
Ma^y of the interviews took place before the recession began, 
table IV-2 presents estimates of prbgram effects by sex and 
follow-up wave, by the number of months elapsed since intake. 



TABLE IV-2 



Adjusted Es4i 




he 70001 Program 



oh Earnings at the "14" Month 




Fbllbw-up Waves, by Sex 



"14" Mbnth Wave 



7-18 Mbhths 



19-29 Months 



Males 
Females 



53 
-29* 



25 
-34* 



24 tb 40-Mbnth Wave 



32-40 Mbnths 



Hales 
Females 



-35* 



12 
-33* 



♦Indicates that the effect itself reaches statistical 



significance at the .05 level. 



« 



The ieiults indicate that, at. least for'^^les, there Js s^^^ 
evidence of decay of program effects independent oj possible 
t^clfAonary efflct.. Even though the 24 to 1^-^^%'"^^^^;^ 
iritlrviews took place at the same point in time, the program 
i^pla7s to haJla larger impact oh males with shorter times since 
iStake than on males out of the program a longer period of time. 
This fioids trt^e for males in the «i4" month wave as well; For 
females the trends are less clear; 

ft third approach to separate out p6ssible recessionary 
eff^St. is to Examine the occupational -"d industrial distribu- 
tion of the participant and comparison groups for the 30b they 
held longest "in calendar 1981. While the 1981 calendar year was 
a recessionary period, the recession Was less severe than ^ it was 
!n May or Sune If 1982. Participant youth may have been m ^ore 
ski llld occupations or in more sensitive industries, and thus 
more liH^ly to lose their jobs because of the tj«^^^ 
?V-3 compares the percentages of employed sample Y^^th' toy 
blrticipanriroup status and by sex, in skilled occupations in 
?Jleidaf 1981 Ind at the time of their 24 to 40.mdhth interviews 
tn 1982 Table IV-4 lists the industry distribution of employed 
s^le youthf by participant group .tatus and by sex, for th. 30b 
held longest during 1981; 

TABLE IV- 3 
Percentages of Employ e d S a mple ? b U t h 



Who Were in Skilled Occupati' 
He Id ' Lonqest^J^a^^l an d ih way and^. 
— by Participant Group Status and 



Job Held Longest Job in May and June 
in 1981 of 1982 



21% 25% 
22% 21% 



Males 

Participants 
Compar isohs 

Females 

participants m J|* 

comparisons 



Mhdicates that difference betv^enl participants and 
comparison group members reaches statistical significance at the 
.05 level; 
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TftBLE IV-4 



Industry Distribution of Sampia Yogi 

in I981t by Participant Group Sta 



Id Lbrigest 




Participants 



Males 



ftgrxculture, forestry, mining 

Construction 

Durable goods manufacturing 

Non-durable manufacturing 

Transportation and Communications 

Wholesale trade 

Retail trade 

Finance arid insurance 

P<srsbh«l services 

Business services 

Entertainmerit & Recreatibri Services** 
Professional s Related Services** 
Public Adniiriistration 



2%* 

8% 

10% 
6% 
5% 
4% 

27% 
4% 
5% 

11% 
2% 

10% 
8% 



2% 
13% 
13% 
13% 
5% 
6% 
19% 
2% 
2% 
14% 
01 
9% 
2% 



Agriculture and mining 
Construction 

Durable goods manufacturing 

Non-durable manufacturing 

Transportation and Communicat ibns 

Whblesale trade 

Retail trade 

Finance arid Insurance 

Personal services 

Business services 

Eritertaiftaent 6 Recreation Services 
Prbfessiorial 5 Related Services** 
Public Adrairiistratiori 



2% 
1% 
5% 

11% 
1% 
1% 

33% 
7% 
8% 
4% 
0% 

22% 
3% 



1% 
1% 
2% 

16% 
2% 
2% 

22% 
4% 
5'i 

10% 
3% 

24% 
5% 



*Percents may not add to 100 due tb rburiding- ^ . _-. 

**i.e.. Theaters, hbspitals, cbnvalescent homes, doctor's offi 

etc. 



ces 
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Table iv-3 suggests hb marked changes between 1981 and 1982 
in the bccupati<5nal position _ of participants relative ^o 
comparisons. The Occupational position of female ^participants 
deteriorates somewhat relative to comparisons, but even |n 
calendar year 1981 female participants were doing quite poorly in 
terms of^occapationai attainment. Table ^^'A "v^t'/nt^ISI 
differences in industry distribution between P^^^^^^^^P^.^^J^l 
comparison youth for calendar year 1981. . "o^tr"^ ' ^P^^^^^'ff 
youth were Sot more likely to be employed in e^ither construction 
or durable goods manufacturing -- two i'i<3"s^>^ies particularly 
hard hit by this recession. Neither of these tables lends 
support to%he notion that wer^ Jt no^t for the P^^^^^^ 
participants would have been in mucb higher earning positions. 

ft fourth approach to disentangling program and recessionary 
effects is to look at changes over time in program effects^ by 
city. The recession had differing irnpaets across the^ five cities 
in the sample. At the time of the 24 to 40-month 
survey, local total uriemployment rates for cities^ in^ the sample 
varied from 6.1 percent in Tulsa to 9.1 P^'^ff"*^ *n,f°fton. If 
the recession had differential impacts on the f^^^^^^^^^^lll 
comparison groups, progran. effects should last ionger Julsa 
than in Boston, with the other three cities falling m between. 

TWO modeling strategies were attempted ^° 
differential effects in cities. First, we estimated models 
separatelVby city at each wave. Second, we interacted program 
Iffecls with city at each wave. Unfortunately, the effects were 
sensitive to the model specification utilized. Further, ejects 
for cities were hot statistically significant and were highly 
variable. The test for differences between ctties was not 
statistically significant. This investigation did .prove 
fruitful probably because of fairly small sample sizes in cities. 

ft final approach taken to separate out recessiona^ry eH^^ 
was to examine the labOr market situation yo"th]inthe^ general 
population during the same time perio^d as the 24 to 40-month 
follow-up. If the bottom completely dropped out of th« labor 
market for all non-college youth durins the spring and summer of 
llsl! thei a case could be made that 70001 youth had no_chance^to 

begii moving into better paying, highei: ^^ill^^. °f ^^5^ Vh'Sn Ihd 
however, some non-college youth still were able to obtain and 
then maintain higher skilled jobs even ^ in the Aace of the 
recession, 70001 participants shb«ia have had a chance at least 
to enter some skilled occupations^ 

To look at youth in the general population, we us^ the Mar|b 
1982 Current Population Survey (GPS) . FOr our purposes, tl?e CPS 
laSple il rLttlcted to non-college, out-of-school youth between 
the ages of 19 and 23. ^^^or market outcomes exam 
current emplop.esit status, current occupation, to tai earnings in 
calendar 1981, and occupation at job held longest in 1981. We 
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compare outcomes for these 19 to 23 year old jfouth in 1982 with 
the outcomes of similarly aged youth in the 1979 CPS sample. We 
also compare outcomes of 16 to 19 year old youth in 1979 with the 
outcomes of 19 to 23 year old youth in 1952, The results are 
presented in Table IV-5 and IV-6. 

ft caveat is appropriate here* We are nb^ propdsihg the CPS 
non-college sample as a comparison group for the 70001 partici- 
pants. The CPS sample defined here has a moeh lower proj)ortibh 
of disadvantaged^ inner-city or minority ^o_u^^- 
sample. The drily aim here is to examir*^ haw_ the recession in 
1982 affected the general labor market situ^ition of non-colleger 
dut-bf-schbbl youth . 



TABLE IV-5 

Labor Maricet^ Outcome s of 19 tQ - ^l jeir Gl^ 
Noticed 1 lege Out^of-School -Yoath^^ii^9la 
and Similar Youth in 198 27"^^^^ ""^ 



1979 1982 



Males 



Proportion employed *83 •73 

Prbpdrtidh currently 

in skilled occupations %29 •2S 

Heah earnings last year $9,546 $8,615 

Prbportibh earning mdre thari 

$10,000 last year* ^37 .33 

Proportion in skilled 

occupations last year *30 .29 

Sample size 3,517 3,687 

Females 

Proportion employed *59 .50 

Proportion currently 

in skilled occupations *30 _.25_ 

Mean earnings last year $S/l54 $5*830 

Proportion earning more than 

$10,000 last year* -06 .16 

Proportion in skilled 

dccupations last year -29 ^24 

Sample size 2,398 1.070 




*1979 earnings h3\?e been adjusted to 1982 levels to take into 
account inflation. 

" is 



TABLE iV-6 



ta bor Market:, Qdt comes for 16 t o 19^ 
Non-CoUeq^ e Oat-pj-^acbool You th i» JL979^^na^g 



1979 



Mates 



.76 .73 



Proportion eitiplbyed 

proportion currently i*- 90 

in skilled occupations il6 .28 

Mean earnings last year $3,805 58,615 

Proportion earning more than _ 

$10,000 last year '^^ '^^ 

Proportion in skilled 

occupations last year •'■^ '"^^ 

sample Size 3-187 3,687 

Feroales 

Proportion employed •6*' 
Proportibh currently ^ -- 

in skilled occupations •IZ -^^ 

Mean earnings last year $2,600 9b, bb^ 

Proportion earnsing morre than 

$10^000 last year 
Proportion in skilled 

occupations last year 

sample size 4,028 

*1979 earnings have been adjusted to 1982 levels to take into 
account inflation. 



.02 .14 
.12 .25 
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table IV-5 helps to show the extent to which the recession 
has affected noh-cbllege jrouth in the 19 to 2 3 par blJ ^age 
cohort. AS compared to 1979r youth in this age cohort now have 
considerably lower employtneht rates and slightly lower represent- 
atibn in skilled occupations. However, the bottom has not 
dropped oufc of the labor market f6r these youjrh. The na3 or it^ 
youth the sample were etfiployed as of March 1982, and at least 
a fair percentage are in higher-skilled occupations. 

Table £V-€ helps illustrate the rooveoent of the 16 to^ 19^ year 
old age cohort in 1979 f com their earlier fKJsition in^the Labpr 
markel to their current position as 19 to jear olds. Whilj 
the percent employed has declined somewhat, youth have progressed 

38 ^r. 



to jobs with higher skill levels^ in spite of prpb§t>ly being held 
back by the recession. There is some evidehce.that the recession 
is impacting on the emplojmient opportunities of this age group. 

&utn!Ttary of Recessionary Effects 

In this section several approaches were taken in an attempt 
to disentangle recessionary and program decay effects. Inspec- 
tion of data from the CPS suggests a deterioration in labor mar- 
ket position for all youth of this age group. The fact^ however, 
thrt participants were not more likely to be in skilled occupa- 
tions in 1981 — hbr more likely to be in sensitive industries 
such as construction or durable goods manufacturing --casts some 
doubt on the premjse that Without the recession, participants 
would be found in much higher earning positions. Also, the fact 
that the position of participant group members is deteriorating 
or at least not improving, at the same time as the position of 
members of the comparison group is improving substantial ly, 
coupled with all of the findings in thi^s section* suggests that 
the recession was not, in itself, the cause of the decay of 
program effects. 

SEPARATING CHILDB EARING AND PROGRAM EFFECTS 

It is troublesome that labor market effects of the program 
are negative ahd statistically significant for females at 24 to 
40 months post-intake. It is possible that participant females 
had more children in the fbllow-up period than comparison group 
females, and were thus less likely to be found in the labor 
market. Table IV-7 shows changes in the mean number of depend- 
ents between intake and the 24 to 40-month follow-up period for 
participant and comparison females. 

TABtE fV-7 

Mean Number of Depe ndents of Female s at Intake 
a nd at 24 to 40 Moni 
"By" Participant Group 

24-40 Month 
Intake Fbllbw-up 

Participants •49* -97 

ebmparisbhs -SS 1-07 



♦Indicates difference between participants and comparisons 
reaches statistical significance at the .05 level. 
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table lv-7 irtdicates that participant and cdjSparison womti 
had children at roughly ttie same rate during the follow-ap period 
with each group addini 0*5 children. Thus» the gap in jnean 
number of children has closed in percentage but not in^ absolute 
terms. table IV-8 prc-'i3es more ihtbrroation on chilobearing 
patterns. It reveals a striking similarity in childbearing 
propensities during the follow-up period. the ^ d i f f erenc^s that 
remain at fbllbw-up are not due to differential childbearing 
during the fbllow-up period, but rather a continuation of the 
differences that existed at intake. 



tABLE IV-8 

Chi I dbearinq Statistics for Participant and Compariso^- 
~ at intake and at 24^to^tg -Month Fbllbw^up Period 



Participant ebmfiarisbh 



percent with children 
at intake 

Percent having children 
during fbllow-up period 

Percent having first child 
during fbllbw-rtjp period 

Percent having Sore than 
ore? child during 
fbllow-up period 

Heah number of children 
per woman both during 
follow-up period 



Percent with children 
at follow-up 

Mean dependents per 
woman at follow-up 



40% 
42% 
231 

6% 

.50 
63% 
.97 



48%* 
41% 
22% 

5% 

671 
X.07 
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♦Indicates statistical significance at the ^85 level. 

One ibgicai explahatibn for why participant females had f^wer 
children at intake than comparisons is that they were simply 
younger, table IV-9, presenting the age distribution of the 
Wonnen in the participant and comparison samples i show? th^t^this 
is the aase. While the mean age of the two groups is similar, 
the actual age distributions are not: 45% of participant females 
were 17 or younger at intake as opposed to 28% of the comparison 
groups 

40 
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TABLE IV-9 



Age^Distiributibh in Percehts of the Fgtnalg Particpant 
anij^Qmpatisbn Samples at Ihta^ 



Age 





15 
16 
17 
18 
1? 
20 
21 
22 
23 



.6% 

17% 
27% 
20% 
14% 
13% 
7% 
.'•>% 
.3% 



3% 
9% 
16% 
241 
23% 
16% 
6% 
2% 
.4% 



Note; Percentag<?s may hot add to 100% due to rounding. 



It might be of interest to ascertain how childbearih^ during 
the fbllow-up period affected program participation effects and 
labor marRet butcbmes; hbwever, this is difficult. On the one 
hand, it is standard prbcedure tb use current values of explana- 
tory variables only for thbse factbrs that could not possibly be 
affected by program participation; Theoretically* prbgratn parti- 
cipation could affect childbearingi Also earnings and emplbyinent 
can affect fertility causing "endogeneity" problems — prbbletns 
caused by introducing an independent variable that can be 
affected by the dependent variable. On the other hand* outcome 
models fbr females using age and dependents at ijatake as explana- 
tory variables will not fully capture the tact that female 

participants # being ybunger, had a lower proportion of chiidren 
at intake^ relative to cbmparisbris, than they did at foilow-upi 
to the extent that natural aging effects rather than program 
participation caused a harrowing bf the differential levels of 
dependents present between the participant and cbmparisbh groups » 
such a model could affect the estimates of the program 
par t icipatibh effect. 

to test for possible program effects on childbearing, a model 
was estimated explaining changes in number o^ dependents between 
intake and the 24 to 40-'aohth fbllisw-up period to investigate 
whether jjrogram paiticipatibh had effects bh fertility. Explana- 
tory variables in the model include age» race, Hispanic 
ethnicity, pre-prbgram wbrk experience^ dependents at intake* 



41 



§3 



ERIC 



family status at intaki^ pre-prbgrarS e .cation, site, and j>onths 
elapsed between intake and foiiow-op- Prd^tam isar tiqipatipn . did 
Sot have a sta t i st ical ly. s ig n i £ icant effect on childbearing 
during the follbW-up period. 

Given that program participation does not appear to _be 
related to childbearing, there is some just i f ic^ation for entering 
current number Of dependents rathet than dependents at^/"*^f J^^^J 
the outcotne models for women. MOte, howevet, that ^this xs not 
technically correct since labor market outcomes^ (the ^dependent 
vIriaBll) can cause changes in an independent ^^"^^1^, 
dependents). However, even current number of dependents does not 
fully capture the fact that participants, ^^^^^"9 J'^^^.f^^J^^^gJ 
nropottion of their children since intake, may have children who 
are younger on average than the children of the women in the com- 
parison group. TO try to t^Ae Anto, accoun^t^pos^^^^^ 
in children's ages, we ran an earnings model that included^both 
number of dependents at intake and changes in the number °f 
pendents since intake. The results suggest that even w^ith a 
variable included for children since intake, program patticipa- 
tion continues to have a negative and statistically ^^fl iUi^ 
effect for females. (Compare Rodel 1 and Model 2 m Table 
lV-13.) 

in a final attempt to deal with Ihe intermingling of child- 
bearing and program effects employment and earniW^^^ 
models were estimated separately for women with children at the 
24 to 40-month follow-up P«iod and women without child i^^^^^ 
that time. It should be noted that this doeg not f_ully djal^with 
the problem of possible program ^^J^ots on fertility.^^Instead, 
it simply assumes that the prograffl had no effect on ch^ldbearing . 
Separatirig the sample into women with children and women without 
children, however, circumvents the endogeneity problem of in- 
ciudthg current number of children (or number of children born 
since intake) in a model explaining employment or earnings. 
Table IV-10 suSmarijes the results of the various attempts ^to 
deal with the issue of childbearing in the earnings models fo£ 
women. program participation continued to have a negative an^ 
statistically significant effect for women yiith children. 
However, for women without children at follow-up, although the 
effect is still negativ?e, it lacks statistical significance. 

fts is cl€ar from the table iV-10^ ho matter how we model 
childbearing since intake, the program lacks a positive effect o^ 
earnings for females. In all cases, except for w^omen_with no 
children at folidw-up, there is evidence that the effect is 
negative and statistically significant. 



ERIC 



42 54 



TABLE IV-10 



Derived 



of girograin Effects 

female Earnings 



Using Al tethative Independent Variables- 

to Tap Childbearing Effects 



Estimategg 
Program Effect 



t-ratio 



Mod.:>l 1^'^ 

Dependents at Intake 
Sample: all females 

Model 2^'^ 

Dependents at Intake 
and changes in number 

of dependents 

Sample: all females 

Model 3 ' 

Dependents at Intake 
Sample: Only women with 
children at fbllow-up 

Model 4c^'^'^_ 

Sample: Only women with 
hd children at follow-up 



-31.65 



-33.19 



-48.58 



^9.80 



-3.83* 



-4.34* 



-5.27* 



-.58 



♦Indicates estimates which are statistically different from 
zero at the ^05 level i 

^These models also include the full roster of independent 
variables . 

^Estimates are adjusted by the proportion of the sample 
working (above the limit). 

^Mote* dependents at intake is excluded from this model 
because all females In this model have a value of zetbi 
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It is pbssibie that we have not fully ca jstu red th^_ fact that 
participants* being younger at intake, now are more like^ly to be 
pregnant. However, responses in the 24 to 40-inonth survey 
indicate that me same proportions of participant and comparison 
females are currently pregnant (see Table ft-III-7in the Appen- 
dix) . It is also possible that we have not fully captured the 
fact that participants, being younger at intake, now have a 
higher proportion of children under six. There is some support 
for this in survey responses in that a higher proportion of 
female participants report family responsibilities and day care 
problems as reasons for being out of the labor force, (Again, 
see Table A-III-7 in the Appendix.} 

Overall, this section suggests that childbearing (or 

differential childbearing^ on the part of two groups) does not 

fully explain the negative effects of the program on 

participants. Even for females with no children^ duri ng the 

foiiow-up period, we find no evidence of positive effects of the 
70001 program^ 

Chapter summary 

We found evidence in ehapter HI that the effects of the 
program ©n weekly earnings for both male and female participants 
and the combired sample have decayed relative to their comparison 
groups! in this chapter, we examined the extent to which the 
Lcession and cliiidbearing among females in the sjJP^J^ "'^V ^f^^ 
been responsible for these patterns of program A«e=ts^^ While 
thire is some evidence that both the recession and chadbearing 
Say have affected program results, it appears that most of the 
change over time in participaftt and commrison earnings 
difflfentials is due to the decay of program effects. 

The general pattern of effects is fairly easy to explain. 
mm participaht and comparison youth started Out unemployed with 
zero weekly earnings. The participant youth were placed by the 
program and opened a wide differential between themselves and 
comparison youth in both tllie percentage employed and weekly earn- 
ings, over time, the participaht youth gradually le^ft or loft 
their jobs and the comparison youth gradually found ^obs on their 
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own or through other agencies. If the__prpgram has no lasting 
effect on participant eraployabil ity , skill level, or labor force 
attachment, the particifjaht and comparisdh groups, j-- assuming 
they are roughly similar— will eventually attain the same level 
of employment and equivalent weekly earnings i 

The fact that participant females end up doing worse than 
comparison females is a little more difficult to explain. One 
possibility is that youths particularly females, do better in the 
labor market when they find jobs for themselves, rather than 
being placed by a program such as 70001. Another possibility xs 
that there still remain some childbearihg effects— such as the 
age of youngest child — which we have hot been able to control 
for adequately in the analyses; 
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CHAPtER V 



OTHER bOteOMES 

Aside from affecting labor ts^rket outcomes sach as empl^o^ 
and earnings* participation in the 70001 program could have ef- 
fects oh a variety of other aspects Of the^ lives of youth. Par- 
ticipatiqh in the program could encOurage entry into the military 
or re-entry to school. the^ jobs provided by the program could 
alter the social and economic situations of youth, and either 
speed up or delay marriage and leaving home. The jobs provided 
by thejsrogram also could help keep youth out Of trouble with the 
law. Table V-1 suminarizes the post-prograin distr^ibutibh Of par- 
ticipant and comparison youth on these other dimensions^ 

As table V-1 indicates* participants are significantly more 
likely than comparisons to have GED certificates, while compari- 
sons are significantly more likely than participants to have reg- 
ular high school degrees at the 24 to 40-m6nthfollOw-up, Parti- 
cipants axe also raore likely (and statistically significantly 
more likely in the case of males) than comparison group raerabers 

to have either a GED or high school degree. Recall from Table 

II-l that Only One percent of the participant and comparison 
samples had £l high school degree or equivalent at intake^ Thus* 
nearly all Of the youth in either sample who have degrees ob- 
tained them after prOgrara intake. 

This increase in education Obtained could be considered as a 
prograiR benefit. Regression models were estimated inspecting the 
effects of background characteristics and program participation 
oh years of education cotfipleted at follow-up (where GED arid high 
school degree were both courited as 12 years of schooling) . We 
found evidence that program participation had a significartt and 
positive effect on increases irieducatiori, chiefly in the form of 
GEDs, suggesting that the program is successful in encouraging 
participants to continue their eddcatiorii It should be noted 
that this difference between participants arid comparisons could 
in part be simply the result of self-sel6ctibri. One of the at- 
tractiOris of the 70001 program is that it offers a chance to pur- 
sue a GED. Iridividuals who enroll in the program probably tend 
towards placing particular value on having a GED certificate. 

Giveri that program participants are more likely to obtain 
GEDs and coraparisbri group members are more likely to receivf 
regular high school degrees, it is somewhat ambiguous as to 
whether this is a program benefit. If GEDs and regular high 
school degrees have the same payoff in terms of subsequent 
earnings, then the fact that more participants receive some fbrm 
of high school degree is a program benefit. If, however, the 
subsequent earnings pajroff for a 6EP is substantially less than 
that of a regular degree, then perhaps this is hot a program 
benefit at all. 
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TABLE V-1 



Ch ara c 



Lics^ at 24 to 40-Mbnth Follow-up 
Comparisbri Youth » by Sex 



of 



Males 



Military: Active duty 

Reserves 
In jail 
Have GED 

Have regular high 

school diplbina 
Have either 6ED or regular 

high school diploma 
Married 

Living with parents 
Recei V i ng sappor t 
from parents 



n 



Participants 
3% 
3t 
6% 
31% 

3% 

34% 
15% 
«3% 

41% 

179 



1 
3% 
6% 
12%* 

9%» 

21%* 

16% 

43% 

42% 

154 



Females 



Military: Active duty 

Reserves 
In jail 
Have 6ED 

Have regular high 
school diploma 

Have either 6ED or 
regular degree 

Married 

Living with parents 
Receiving support 
from parents 



.7t 
.4% 

0% 
21% 

8% 

29% 
20% 
38% 

33% 

272 



0% 

.4% 

0% 
13%* 

12%» 

26% 
26% 
39% 

331 

238 



•Indicates difference between participant and compati 
groups reaches statistical significance at the .05 level. 
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It is intc; sting to note that the program does hot appear to 

increase the percentage of male participants entering the 

military. Sample size limitations make it difficult to make a 
judgment oh the effect of 700B1 on military enrollment; Simply 
iooking at youth bh active duty r three percent, of participant 
males and one percent of co^apar ison males ajce in the mi 1 ita?y . 
Looking at propdrtipns of those who have been jbr are) oh active 
diity^ reserves and veterans since intake^ the corresponding 
numbers ate seven percent and six percent. In the Job Corps 
study r Mathematica found that comparison malos had 3 f^ur percent 
probability of being in the military and participant males had a 
nine percent probability of being. in the mi 1 i tary, with the 
difference being statistically significant. Clearly 70001 is not 
helping youth get into the military at the rate that the Job 
Corps is. In 70001 the actual numbers are quite small and the 
differences azn not statijiticaiiy significants For females, five 
participants and one comparison were on active duty, in the re- 
serves^ or a veteran since intake. But the five participants 
reflect only two percent of the female participant sample, and so 
it can hardly &i» said that 70001 is moving large numbers of 
females into the r.:ilitary. One of the main reasons the Job Corps 
appears to have an enduring effect oh the earnings of male 
participants is that it increases enlistment in the armed forces. 

It is possible that the 70001 program A? fec^^^ the decisibps 
of youth to enter other educational and training prbg^ Oh 
the one hand, participation in the classroom trainijtg olemeht of 
the program may increase awareness of educational options availa- 
ble^ On the other handr the job placements provided by the pro- 
gram may serve as ah alternative to continuing education or 
training. 

Table V-2 presents school br training ehrbllmeht ift each of 
the throe follow-up waves. Table V-3 examines past part igipatioh 
in educatiohal and training prograass. Table V-4 inspects the 
itypos of educatiohal and traihihg programs in which the youth 
were currehtiy enrolled at the third follow-up interview. Tiie 
three tables indicate that there is some difference in the p^st 
and current enrollment of j)articipahts_ and cbmpar isdn^ In educa- 
tional and training programs^ The differences in educational at- 
tainment , however ^ do not appear particularly striking^ nor are 
they statistically significant. 

Because a slightly larger number of participajits are current- 
ly ohroUed in school or training, this raises some quesUohs as 
to whether this could contribute to a misleading low estimate of 
long run prbgram effects bh earnings. However # the number of 
sample youth who list education and traihihg as their current 
main activity is quite small. Only four percent of participant 
malesi. one percent of comparison males^ four percent of partici- 
pant females^ and two percent of comparison females list school 
or traihihg as their reason for being but of the labor force. 
(See table A-III-7 in the Appendix). 
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TABLE V-2 



at Each^ol tow-up Wave^ by Participant Gr 



Enro llmen t in Educational or Tr 




rams 



and Sex** 



participants 



s 



Males 



"9"-ro6hth 

"14"-S6nth 

24 to 40-nionth 



19% 
20% 
14% 



11% 

6%» 
12% 



Females 



"9 "-month 

"ll^-month 

24 to 40-month 



23% 
15% 



17% 



11%* 

10% 

13% 



•Indicates difference between participant and comparison group 
reaches significance at the i05 level. 

**It should be noted that enrollment here does hot necessarily 
imply full-time student status or that the individual is out o 
thi labor force. In the 24 to 40-mohth follow-up wave, only 4 
of participant males, 2% of comparison males, 6% of ^participan 
females* and 5% of comparison females listed education or 
training as their current major activity* 
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TABLE V-3 



Enfn^lmp^ht m Educatiohal or Training Programs 

24 to 4g-J1bhth Follow->up y 
by Participant 6rQtip_^tatus and Sex * 



Participants Comp a ri sons 



Males 



CETA 25% ^5% 

Technical or trade 

40% 34% 



courses 



College courses 10% 

Union apprenticeship 3% 3f 

Job Corps 4% 8* 

Other training 7% 10* 



n 



179 154 



CETA 26% 29% 

Technical or trade 29% 31% 

College courses 10% 

Union apprenticeship 1% 

Job Corps 3% 71 

Other training 6% 7% 

h 272 238 



♦This table does not represent '•pre-program'' educational 
attainment, but rather education and training already completed 
at the 24 to 40-Thonth follow-up (as opposed to being still ih^ 
progress) i Since roost of the substantive training and education 
represented in the table occurred since the baseline data was 
collected, differences between the participant and coroparison 
groups should not be controlled for in the outoroeanalysis in 
Chapter III (because program participation could have affected 
subsequent decisions to enroll in the Job Corps, a community 
college, or a technical sch6dlj# 
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Current Enrollment in F^agatidnal or Training Programs 
at 24 to 40^Mdnth FQllow->ap^^>j^ art i c i pan t Group Status and Sex 



Mates 
CETA 

Regular high school 
GEO program 

Technical or trade school 
4 -year college 
2-year college 
Go! lege courses 
Union apprenticeship 
Other traininc; 

n 

Females 
CETA 

Regular high school 
6Eb 

technical or trade school 
4 -year college 
2-year college 
College courses 
Onion apprenticeship 
Other training 

n 



♦Indicates difference between participant andcomparlson 
groups reaches statistical significance at the .US level. 
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Participants C etpparisdns 



2% it 

II 2* 

5% 6? 

6% 5% 

II 0 

3% 1% 

1% 1* 

1% 0 

11 1% 

179 154 



31 3S 

1% .4* 

7% 4%» 

7% 51 

.41 .41 

2% 1% 

0 1% 

.4% 0 

1% 2% 

272 23« 



Firially^L we examined possible program effects on welfare de- 
pendency of participants. In integrating these results, it 
should be recalled from the previous chapter that a i^lightly 
smaller percentage of participant feroales have chi ldre*5 relative 
to comparisons (631 versus 68%) and that tWe chiXdren of partici^ 
pants will tend to be a little yoanger^ oh average thati; the child- 
ren of comparisons. Table V-5 contrasts participant and co^p^ 
parison group members on a variety of measures of welfare 
dependency . 

table V-5 indicates no post-prog^^^ di^^erence in welfare or 
foodstarap recipiency between participant and coDBpari son females* 
For males^ no clear differences between part icipants and 
c6mparisonj5 emerge^ although males are much less likely to 
receive transfer payments than females • 

Summary 

The only other benefit of the 70001 program that was found to 
be statistically significant is attainment of GED certificates: 
31 percent of particijpaht males and 21 percent participant fe- 
iitales have obtained a GED as opposed to 12 pi^rcent of ccmparison 
maleii and 13 percent of comparison females^ !t i^s possible that 
this will have longer term effects on participant labor market 
outcomes. 

We found no evidence that the program has effects oh other 
outcomes such as military status^ criminal activity* marriage^ 
enrollment in educational and training programs/ or dependency oh 
welfare or parental support. 
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Degendeney jn ftFDC and — PaQdstamps , 
by Patticipant Group 



Fenales 



ftFbe at Ihtakef^ 
Currentiy receiving AFDC 
Currently receiving 

Food stamps 

AFDC last year 
Fbodstaiaps last year 
Months on AFDC 

ast year» for those 

on AFDC 
Average AFDC per month, 

for those currently 

on AFDC 
n 



28% 
35% 

38% 
34% 
43% 



9.8 



$215. 
272 



Cbmplttisons 

38%* 
33% 

34% 
35% 
43t 



9.7 



$202. 
238 



Hales 



arisen 



AFDC at IntaRe* 
Currently receiving AFBC 
Curtehtly receiving 

Fobdstainps 
Ai?be last year 
Foodstamps last year 
n 



71 
2 

7% 

0 
7% 

179 



271 
1% 

5% 
1% 

ill 
154 



stndicates differences betws^en participant and cb^iparison 
groups reaches statistical significance at the .85 level. 

^ Note that AFDC at intake included assistance both to the 
youth and to their families. 
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CHAPTER VI 



PROGRAM COST-ErFECTIVESESS 

In the previoas P/PV report^ oh prerempldytBent proira«s« we 
found evidence that the labor market effects of the JPY-Boston 
program were found to have decayed over timci With the fbilbw-up 
data available at that time, it was unclear whether effects of 
the 70301 program would be maintained over time or whether they 
would also decays the report concluded that foilow-up informa- 
tion or^r a more extended period of time was needed before a 
judgment could be made on the long- term cost-effectiveness of the 
70001 program. With the additional data from the 24 to 4fl-nionth 
interviews, it is now possible to maRe a mOre definitive estima- 
tion of 70001 's cost-ef fectivenessi 

There are three per spec Hx^es from *hich to analyze the costs 
and benefits of the 70001 program— society af. a whole, tax- 
payers, and individual participants. Frons the point of view of 
the gOverhmeht, the most appropriate benefit-cost analysis is 
from the perspective of society as a whole. From the societal 
perspective, 7000i's costs include ilj the costs of operating the 
program at each local site, as well as any administrative costs 
at the national level; and (2) the opportunity costs to indi'/id- 
uals for participating in the program. Benefits from the pro- 
gram, from a abciefcal perspective, include (1) increases in pbst^ 
program earnings of participants ? and (2) other potential 
benefits from the program such as re<3Mc<F3 criminal 1 beha 
abuse reliance ore q^verhmeht transfer programs. In the 

benefit-c;ost ratios and payback periods estimated below, only 
post-prograw earnings, gains of participants aje included as bene- 
fits. No attempt is made to include estimates of reduced crimi- 
nal behavior since we had not made a ebhcerted effort to obtain 
before and after measures on such factors. From the cOst side* 
we have excluded information on costs at the national level. 

The 70001 program is fairly inexpensive in terms of oper- 
ational costs. tabl<; Vl-l lays bet the costs of operation of the 
program and calculation of costs per participant* The^^lf?51 
cbst per participant figure is derived from prbgr^am costs in 1979 
and the first quarter of 1980, w^ien the youth in the sample 
entered the program* 

Given that 70(8i»l participants only take classroom training 
for a few weeks^ the program is also fairly inexpensive in terms 
of oppbrtuhity costs* Even if JNalf the participants could have 
found jobs within the first week of classrooifi training, the op- 
portunity cost would bhly ambuht to $100 per participsnt. The 
benefit-cost ratios caicjulated below include $100 per participant 
in opportunity costs. Because opportunity cbsts are low relative 
to admihiatrative costs, th© benefit-cost ratios are not particu- 
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TABLE VI -i 



Costs in the ?g0gi Proefraa 

(January 1979-April 1980) 

Expenaitutes 

Operating $626^493 

Administration 108*691 

Total $735,184 

Nmnber of participants 544 

Number of participants placed 296 

Cost per participant $1,351 

Cost per placed participant $2*480 



larly sensitive to the bpport;jhjty cost figure chosen. Even if 
2ero opportunity costs are ass^^ed — or if the $100 opportunity 
cost figure is doubled — the benefit-cost ratios reinain roughly 
the same . 

In the benefit-cost ratios presented ijh Table VI-2, the 
benefits are derived from the estimates of program earnings 
effects over time listed in table III~9. fts alternative esti- 
mates of program impact over time were presented in Chapter I U 
depending oh various rtiodel specifications, alternative benefit- 
cost ratios are presented here depending on the model specifi- 
cation and discount rate chosen. 

in the past report, positive yet statistically insignificant 
values of program impact were utilized as the estimates of pro- 
gram effects rather than zero, because the program effect is more 
likely to be that estimate than it is to be zero, even though^ the 
estimate is Sot statistically different from zero. Wo follow 
this convention here as well. This means that positive, yet 
statlsticslly irsigni f icaht * values are treated as the program 
benefit, as are negative statistically insignificant results. 

Last, it f>hould be noted that substitution effects are ig- 
nored* therefore potentially overstating the program's cost- 
effectiveness . 

fts the results in Table VI-2 Indicate, the fiomewhat crude 
cqst-benef it analysis provides evidence that benefits from the 
70001 program outweigh costs for male participants under all 
model specifications. For females, and for the combined sample, 
program benefits do not outweifh costs under any model specifi- 
cation. The results for females and the total sample derive from 
the fact that early pacticipaht earnings gains are offset by 
later losses vis-a-vis the comparison group. 
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TABLE VI-2 



Behefit-Cbst Ratios Under Alternative 
Discbuht Rates and Hbdeling Spf^^cif ications 

MSel 1 Model 2 HcnJel 3 Model 4 



Males 

5% discbunt rate 3,19 2-92 1.32 2.20 

10% discount rate 3.01 2.79 1*30 2.13 

5% discount rate -2.15 -i.\8 .44 --17 

10% discount rate -1.90 -1.11 .42 ^18 

Total 

5% discbunt rate .29 .49^ .95 *99| 

10% diseburit rate .33 .47^ .94 .97 



NOTES : 

Model I is wave by wave. 
Model 2 is pooled. 

Model 3 is wave by wave^ with ho cbrrectibh for selection 
bias. 

Model 4 is pooled^ with no correction for selection bias* 



^Since pooled models could not be estimated for the total 
sample to compute these nutnberSf these calculations were done by 
weighting the male and female estimates by their proportion in 
the damply in each wave. 



table Vl-3 extends the benefit-cost analysis to a determi- 
nation of the program's payback period under aiternative model 
specifications. A pay back analysis asks the question# *'How long 
will it take participants to pay back society for the cost of the 
program with the increased earnings resulting from their program 
participation?** 

fts is shown ir^ Table Vl-S, males are abl/$ to pay back the 
coftt of the program in slightly over a year. Pemalifts are never 
able to pay back the cost of the program. For the combined sam- 
ple, because negative effects for females balance positive 
effects for msleSr the program is not quite able to pay back its 
costs under any model specification. 
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TABLE Vi-3 

Pay bacJ c^g riaa^Ji years of the 70001 Pcogram 

Under A'l'ternatige flodel Specifications 

(Zero Discotint Rate? 

Model 1 Hbdei 2 Model 3 Model 4 

Males 1.2 
Females 

Total XX 



1.1 

XX 

xx^ 



1.3 

XX 
XX 



1.2 

XX 



XX 



a 
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NOTES: 

XX indicates the gffograrn never pays t)ack its costs. 
Model 1 is wave by wave. 

Model 2 is pooled. . - , 

Model 3 is wave by wave, with no correction for selection 

bias. i t • i. 

Model 4 pooled, with ho correction for selection bias. 

^ Since pooled models could not be estiraat»a for the toLal 
sample, these pay back calculations were done by «figh ting the 
raal^ and female estimates by their proportion m the sample at 
each wave . 

In the previous P/PV pre-employment report, we concluded that 
additional follow-up informitidn was needed on the 70001 progriiiD 
before a final determination on program cost-effect jveness _ coul^ 
be made. The report also stated that if simple deceleration of 
program effects over time continued, the 70001 program's payback 
piriod would be 1.04 years. The additional follow-up data shows 
that orog-am effects have decayed much more rapidly than 
Jypect' J, and tnat f^r the combined sample, the program is never 
quite able to p?*' '^sck its costs. 

gummary 

Eeriefit^cost calculatibns for the 70001 program were dorae 
under ai ernative model specifications and discount r|te assump- 
tions. Fcr males, program benefits ,outweigli,cost^. Jo^^Jl^llH 
and for tha combined sample, program benefits do ^^^^t outweigh 
cc^ts. a pay back analysis also was used to evaluate^ pr^ogram 
cOst=-effectiveness. For males, the program pays f or i tsel^f ^ in 
sUdhtly over a year. For females, as for the combined sample* 
the program never reaches a point of paying for itself, regard- 
less of *:he model specification usedi 
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It shbuld be remembered that thi§_ cos t_-jLfJe analysis 
is a bit crude and pertains to the five 70001 sites as operated 
from 1979 to early i980* Ghahges in the program since then may 
have altered costs as well as benefit streams • 
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Notes 



i) B/ecause there appear to be stronger program effects for 
males than for females i at first glance it may appear 
that the program could increase its long run impact 
simply by Increasing the number of males relative to 
females in the program. Howeveri there may be stronger 
effects for males precisely because they are fewer in 
nuETiber in the program.. The males who do enroll in the 
program may self-select themselves because they have 
^eeds Jhe program can fill. A more ir'Ifnsive 
recruitment of males may simply bring in individtial^ who 
are not particularly suited to the program. 



60 



n 



ERIC 



CHfiPTER VII 



SUMMARY AND iMPtlGATlONS FOR FOLIC? 

This report represents the completion of P/PV*^ evaluation of 
pre-emprpyment programs as potent i^al stra teg ies for moving 
disadvantaged youth into private sector jobs. it has ihsj)ecfced 
the longer run impacts of the 70001 program by analysing data 
from the last wave of fdllow-up interviews of 70001 participants 
and cdnnparisdn group members at 24 to 40 months after intake into 
the jprbgram. In this chapter^ we summarize what was learned from 
the last wave of follbw-up interviews and then make 
recomtnendatibhs* 



WHAT WE HAVE -LEAKM^D 

The fbl lowing f i hd i_n_gs__are deriv<?G irota the last wave of 
fbllbw-tjp interviews oh 70001': 

o We found ho evidence that the 70001 programs investigated 
here have impacts oh the longer rvan employment and 
earnings of their part icipahts._ Whili positive effects of 
the program were found at •*g'' and **i4'* tnonths after 
intake, by the 24 to 40-roo^^ period, we found 

evidence that these effects had decayed^ Th^ effects in 

the 24 to 40-month post-intake per iod are near^ zero for 
the total sample and for males^ but negative and statis- 
tically significant for females,__ No evidence was 
uncovered to indicatv that 70001 impacted on the 
occup^tibhai ski 11 ie^^ hbr on the annual 

earnings of participants in calendar year 1981^ that is^ 
21 to 33 months after program intake. 

b There is some evidence that the pr-^gram positively impacts 
bh acquisitibh of schbbling. 

b the apparent decay of program effects in this 24 to 

Sbhth peribd results in large part from an i?t?svrovemenfe in 
the labor nnarket pbsitibh of the cbmparison groups in the 

face of a deep recess ion r at the same time that the 

participant.^ are experiencing a slight deter ibratibn of 
their posi tidn in the labor market. There i ?r l ittle 
ebhvihcirig evidence that_ the recession was largely 
responsible for the decay of program effects. 
Differential chiidbearing hy the j>articipaht and 
comparison groups cannot explain the negative prbgr am 

effects for f ema 1 es a 1 though ch i 1 dbea r^i ng a nd 

responsibility for dependents has clearly been in flu^^^ 

in the differential patterns of labor force behaviors of 

the male and female participants. 

b The program is relatively inexpensive when compared With 
other treatment modalities. However ^ it is one of the 
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more expensive pre-employrnent programs that have been 
studied by the Department Of Labor. 

o When using a crude cost-benefit technique (payback analy- 
sis), we found evidence that the program xs not cost- 
effective for females, as females can never pay^ back the 
cost of the program. The program appears to be quite cost 
effective for males as they pay back ttie cost of the 
program in just over one year ^ and does not appear to be 
cost-effective for the overall sample, as participants 
come close to but are never quite able to pay back the 
cost of the program. (Note that this reversal from the 
earlier ^report is due to the fact that early participant 
gains »ere offset by subsequent participant losses 
relative to the comparison group*) 

this last wave of follow-ups for 70001 Was done ^ because 
certain questions remained aJLter completing the earlier 14 
month" post-intake analysis. JFY and 70001, two roughly compar- 
able pte-employment programs, exhibited ^^i^^^ff . P%"f 
effects. While a number of explanations could be ruled out 
Jmpiril^ny, we could not ascertain whether these divergent 
patterns were due to differences in the progr^^^^^ 
two programs exhibited the same pattern of effects with the 70001 
program effects lagged by a number of months due to the use o£ 
artifical terminatibh dates. The results from this third wave of 
analysis help to resolve the quandary. 

We how have evidence to support the explanation th&t 70001 
and JFY have comparable patterns of program effects, »ithJ0001 
effects being lagged a number of months most probably due to the 
use cf artifical termination dates. Both programs have positive 
effects in the shbrt-ruh but_ program effects decay quite rapidly 
as comparisoti ydsath find their own jobs. 
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The research confirms that well-run pre-employment programs 
such as 70001 can: 

o place disadvantaged, out-of-schoM youth in private sector 
jobs at a low cost per placement and without offering 
direct subsidies to employers (nor do employers take 
advantage of tax credits) 

o attract same youth to Job-readiness training activities 
without paying a stipend 

o increase youth earnings, at least temporarily, relative to 
a comparison group 

o work for youth under 18 as well as for older youth; 

62 _ _ 

73 



ERIC 



Moreover, it shbuia be noted that the 70(30i prrqrams ih^^estigate^ 
here have a mbire enduring labor rriaricet impact than many other 
such pre-empl oytneht programs studied by the Department of Labor i 

However, we have found no evidence that the 70001 programs 
investigated here have permanent or long run effects on the 
eihpldyabillty of youth, as measured by subsequent like^ 
employmeht, earnings or type of 30b h*ld at 24 to 40 months after 
intake to the program. (Note, in this longer term follow-up, 
partieipatiGh in 70001 did positively affect GED attainment.) 
thus, while the program meets many of its objectivesj such as 
placing youth in private sect ' jobs and increasing earnings ^ ih 
the sho^rt run, we f^hd ho evidence of the ssbility of these five 
70001 programs to perinahently affect the youths' longer ran 
employability. In short, the programs place youth in private 
sector jobs, allowing them to reap earnings gains^ but eventually 
cbmparisbh grbUp members will get jobs on their own and the 
advantage to participants disappears. Despite the fact that the 
70001 programs meet many i^mpbrtaht bbject Ives, one is left 
wondering whether pre-ecnplo5rmeht programs sv:rh as 70001 are good 
sbcial investments. For while these programs are able to 
increase participants' earnings in the short run, tjiey do not 
appear to be able to increase youths' earnings i.-^ the long run. 
Additional interventions might be required subsequent to pre- 
emplbymeht experience to sustain the earnings gains produced by 
the program. Especially for youth under 18 years of age» pre- 
emplbymeht programs like 70001 may be only the first step in a 
series bf necessary interventions. 
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TABLE A-II-1 



eha^ racteristics at Intake. ParjJ^iij^t an d Comparison 
^ ^ Sampl'eFr Hale 



Average age 



Participants Compari sons 
17.74 17-91 



Ethnicity 

wi^^t «i4% 59% 



black 54% 
Hispanic 
white 



High School degree 
Average reading score 



Ever held pre- 
pro^reira job 



Family of one 
Receiving AFDC 
n 



27% 20% 
17% 20% 



1% 1% 
6.9 6.7 



Average pre- _ 

progr?im waq^ $2.47 ^z.^f 



82% 86% 



Average number 

of dependents -IZ •^^ 

Head of household 6% 10* 

Member of family 



80% 74% 

14% 161 

81 2% 

218 176 



^indicates difference between the participant and cbmparison groujis 
reaches statistical significance at the ^05 levels 
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TRBLE ft-II-2 

Charact eristics at Intake^^^a rt ic i pa at— aiid ebniparisbn 
^ " Sample s g Fe xnal^ 



Participants Comparisons^ 

Average age 18 03 18^39* 

Ethnicity 

black 68% 66% 

Hispanic 22% 20% 

white 9% 13% 

With High School degree 1% 1* 

Average reading score 6^7 6.6 



Average pre- 
program wage 



$1.79 $1-93 



Ever held pre- 
program job 62% 68% 

Average humbet* __ 

of depehdehts .49 i65* 

Head of household 16% 16% 

Member of a family 75% "^8% 

Family of one 9% 6% 

Receiving AFDC 22% 24% 



n 



317 264 



*Indicates difference between the participant and cbmparisdn 
groups reaches statistical significance at the ^05 level. 
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tftBLE A-II-3 



Attrition in 24 to ^.g-Month^i 
Sample^ Hale 

Barticipahts 
" Attriters 



Average age 


17.78 


17.56 


17.82 


Ethnicity 
biack 
Hispanic 
white 


54% 
28% 

i C ft 


56% 
18% 

"714 

^ i. V 


58% 
22% 
201 


With High School 
degree 


1% 


0% 


i% 


Average reading 
score 


7.0 


r h 
u • o 




Ever held pre- 
pfugraffl job 


811 


83% 


86% 


Average pre- 
prbgrant wage 


$2.46** 


$2.51 


$2.84 


Average number 
of dependents 


.11** 


.18 


.23 


Head of household 


5% 


8% 


8% 


Member of fannily 


82t 


77% 


78% 


Family oi one 


13% 


15% 


14% 


Receivir^g AFDC 


8%«* 


8% 


1% 


Atlanta 
BdstOvi 
Richmond 
San Antonio 
Tulsa 
h 


11% 

16% 

25% 

30%** 

19% 

179 


18% 
18% 
21% 

13t* 

31% 

39 


12% 
21% 
20% 
19% 
28% 
154 



Comparisons 
Followed Attriters 

18.55 



68% 
9% 
23% 



0% 
7.0 

86% 
$3.03 

.50 

23%* 

50% 

27% 

5% 

32% 
32% 
9% 
0%* 

27% 
22 



•Indicates difference between those foUowed-up and attriters 
reaches statistical significance at the .Uj level. 

♦•Indicates difference between participants and cbiSpirisons 
follbwed-up reaches statistical significance at tlte .05 level. 
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T/'ABLE ft- 1 1-4 



Attrition in 


24 to 40- 






■ ;. ions 






Participants 




Fo 1 lowed-* 


Att? iter s 




ft ^ 1* t 4^ 1 












Average Age 


17.99 


18.24 


18.41 


18.23 












black 


69% 


58% 


67% 


58% 


Hispanic 


21% 


2i3% 


21% 


19% 


wh i to 




18% 


12% 


23% 


High School 










deg tee 


1% 


2% 


1% 


0 


Average reading 








7.2 


score 


6.7 


6.8 


6.6 


Ever held pro- 










prbgraS job 


62% 


64% 


67% 


81% 


Average pre- 








?2.46 


program wage 


$f..77 


$1.91 


$1.87 


Average humber 








.73 


of dependents 


* 




.64 


Mn:Sk/4 A M CO K l4 
n"clG O L (I U U9t; 1 1 X (J 




JL «7 Xk 


17% 


3* 


MfsttmHi^r of Faiiiiiv 


75% 


71% 


78% 


77% 


Family of one 


3% 




5% 


23% 


Receiving h€DC 


24% 


ii%* 


24% 


19% 


Atlanta 


23% 


22% 


29% 


31% 


Boston 


20% 


27% 


9% 


15% 


Richfliond 


20% 


9% 


20% 


151 


San Antonio 


24% 


20% 


23% 


23« 


Tulsa 


13% 


22% 


18% 


15% 


h 


272 


45 


238 


26 



♦indicates diffecehce between those foil owed-up and attriters reaches 
statistical significance at the .05 level. 

^♦Indicates difference betiireeri participarits and comparisons followed- 
up reaches statistical significance at the .05 level. 
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TABLE A=II-5 



P r oh i t E s t i m a fee s^ q f S e 1 ec t i o n 
into 70001 Pw q ram. H ales 



Cblelf icieht 



Ethnicity 

black 'III 

Hispanic "'^c? 

Age at intake ~*cbl 

Education level "si^ 

Head of household '^1? 

Family of one ill 

Number of dependents ''Ita 

Intake in Winter "'1%% 
Intake in spring 

intake in summer 

Local uhemploynsent rate "ill 

Ever held pre-program job i iql 

Employed at intake ~ 57? 

Atlanta (fop Zip) '^71 

Boston (Top Zip) '''^ 

Richmond (top Zip) '^H 

San Antonie (top Zip) I'ltl 

Tulsa (Top Zip) lt% 

Atlanta -JJ^ 
Boston 
Richmond 

Sah Ahtbhib ; 
Constant 



1.043 



Sample 3ize ^ 392 _^ 

PrbportiOR bf participants in sample =551 
€hi-square « 142,00* with 22 degrees freedom 



♦indicates statistical significance at the ,S5 level, 



Si 



TftBbE ft-iI-6 



Prbbifc Estiinates of SelecUon 
into 70001 Pro'jrain, Females"' 



Vat iables 



Ethnicity 

black 

Hispanic 
Age at intake 
Education level 
HeacI of house. rold 
Fatni ly of one 
Number of dependents 
Intake in winter 
Intake in spring 
Intake in summer 
Local uhemploymeht rate 
Ever held p re-prog r.ini job 
Employed at intake 
fttlanta (Top Zip) 
Bbstbh (Top Zip) 
Richmond (Top Zip) 
San ftntbhib (Tbp Zip) 
Tulsa (Top Zip) 
Atlanta 
Bbsto/ 
Richmbtrd 
Sah Ahtbhio 
Cbhstaht 



ebef f icieht 



t - Ratio 



.102 

-.038 
-.503 
.285 
.307 
-.253 
-.117 
-.259 
.274 
-.052 
.231 
-1.299 
.374 
.129 
.436 
-.178 
1.029 
.469 
1.062 
.081 
.779 
2.031 



0.45 
-0.92. 

*7a7* 

1,5? 
1*35 
*2*63* 
«0,S6 
• 1 • 56 
1*55 
«0*46 
1*75 
*5,45* 
1.71 
§..42 
i»63 
*0.66 
2.68* 
0.89 
2.36* 
0.26 
1.61 
2.52* 



Sample size « 579 _ 

Prbpbrtibh of participants in sample = 55% 

Chi-square = 166.07* with 22 degrees of freedom 



*Ihi5icates statistical significance at the .05 level, 



81 

o 
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TABLE fi-III-1 



Estimates d^^ttxe Effect of the 70001 Program on the Pr< 

of Egploymeg^t at 24 to AB-Hohth Fbllotf^up^ Total Sarnple 



Itidependent Variables Coefficient t^ratio 

Ethnicity 

hiack 

Hispanic 
Education level 
Ever held pre-prdgram job 

Age at follow-up 

Dependents at intake 
Head of hvousehold 
Family of vOne 

male 
Atlanta 
Drorton 
ftcichimDnd 
San ?.ritonio 

tafiflbda (correction for selection bias) 
Constant 

Sample si^e = 828 _ 
Proportion employed = .40 
Chi-sqaare with 15 degrees of freedom 



♦Indicates staticticai significance at the .05 level. 



-.49 


-3.18* 


-.37 


-1.50 


-.02 


-.32 


.17 


1.60 


-.06 


1.76 


-.09 


-1.02 


-.003 


-.02 


-.02 


-.13 


.37 


3.67* 


-.18 


-1.09 


-.17 


-1.01 


-,18 


-1.00 


-13 


.51 


-,01 


-.05 


-1.09 


-1.S8 


* 




= 62 




the .05 


level. 
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TABLE A-Ili-2 



Estimates o) 

of Ejnnl 



■Effect of the 70001 Program dh the Probability 
tt^^atL-^ to 40-MQhth Fblldw-up^ by Sex 



Males^ 



independent 
Variables 



Coefficient 
(t-rati^ 



Coefficient 



Ethnicity 












black 




.35 




— 


.64 




(-1 


.62) 


{ 


-2 


* 


Hispanic 




.01 




- 


.73 




(- 


.02) 


( 


-2 


;33)* 


JI«U U <3 L. X ^11 a. tr^ V tr i 




.04 






.06 












.69) 


Vxii^T \si^\f\ ori*— Drc5Q irani "iob 




.21 






.16 


(1 


.04) 




a 


.24) 


Ad^ a^ fdllow-cr* 




.03 






.06 


( 


.61) 




(1 


.36) 


Dependents at intake 




.19 






1? 




( 


.91) 


1 


J. 




Head of household 




-.21 






.01 




(- 


.53) 








Family of one 




.23 






. 


(1 


.02) 




(- 


.62) 


Participant 




,37 






.40 




( 


; 94 ) 


( 


-1 


i\3 l) 


Atlanta 




.13 






.32 




( 


.47) 


( 


-I 


;50) 


Boston 




.03 






.25 




j 


.12? 




(- 


.96) 


Richmond 




.29 






.09 




(-1 


.20) 




(- 


.43) 


San Antonio 




.32 






.00 




J 


.72) 




(- 


.01) 


Lambda (correction for 




.23 






AA 


selection bias) 


(- 


.88) 




Al) 


Constant 


-i 


;00 






.53 




(- 


.99) 




(- 




Sample size 






504 


.33 


Proportion employed 




.51 






Chi-sguare with 14 degrees 












of fre^dotti 










^Indicates statistical significance 


at 


♦•he .05 


level 
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TABLE ft-III-3 



Mj-nsted Estimates of Effects of 



oR Weekly Earnings Total Sample 

^Kithoat Correction ^or Select ion^iasj- 



Prograiti 



Independent Vairiables 

Ethnicity 

black 

Hispanic 
Education level 
tvi}r held a p2:e-prdgrarn job 
Age at follow-up 
Dependents at intaKt:^ 
Head of hbosehdld 
Familjf^ of one 
Sex 

male 
Par fticipant 
Atlanta 
Bos ton 
RicHTnohd 
San Antonio 
Constant 
Sigw^ 



Coefficient* 



t-ratio 



-35.69 


-6.41* 


-«1.15 


-4.49* 


-1.12 


-.56 


11.42 


2.68* 


.78 


.65 


2.89 


.84 


-7.98 


-1.23 


15.54 


2.64* 


43.41 


11.08* 


-2.12 


-.55 


-10.45 


-1.65 


-1.55 


-.26 


-22.84 


-3 51* 


13.^0 


1.54 


a 


-.15 


39.95 


21.85* 



2? size = 828 , ^ 

itioh of sampl; with positive earnings (above limits = .40 



Sanijp 

Mean iii^eekly earnings = $f2.72 



^Coefficients have been adjusted by the proportion above the 
i intit • 

*lrdicates statistical significance at the •BS level. 



Adjiistea, Estimates of th-? Effect of the 70001 Program 

aXLjCCl to 4 6 -Month Follow-up # Jby Sex 



tr.^Saleitibh Bias) 



Males 



independent 
Vac tables 



Coefficient 
(t- ratio} 



Coefficient 
(t-ratio) 



Ethfiicity: black 


-39i84 




(- 2 . 0z) * 




Hispanic 


-51 .2 3 


4 3 • _ _ 


{- « 97) 




- 

Educatibh level 




- «I7 








Ever held pre-prograim 3Pb 


o o an 


_ • / y _ _ 


1 . y 


/ 0 1 \ * 


Age at fdllcw-up 


4 i ^ ■ 


« o J 


( 1 . " : 


( .99) 


Dependents at intake 




-2.55 




(.79) 


(-1.14) 


Head of hoasehvoia 


-59 79 


* •01 




(-1 .?9) 


(-.00) 


Family of oner 


29.58 


/ « 4 1 




f .41) 


Par ticin^int 


4.30 


4.93 




(.32) 


!-1.6?) 


Atlanta 


-10.30 


-I 'i .07 




(-.45) 


(-2.781* 


Beston 


17,19 


9.5i 




(.€9) 


(-1.94) 


l^ichrtiond 


-42,19 


10.66 




J-2.37) • 


(-2.17) * 


Sah Ahtoriio 


55.10 


-.02 




(1.03-/ 


f-.00) 


Constant 


-57. 9T 


22.83 


(-.72) 


(1.20) 


Sigma 


95.70 


19.26 


S>rnplo size 


324 


504 


Proportion with positive sarhir-^s 




.32 


(above I iSi t) 


.54 


Mean weekly ersrnings 


$97.22 


^•»0.54 



^Coefficients hive been adjustc^d by the proportion abov^ the 
limit* 

*lndica:es coefficients v/hich reach statiBtlcal signif icanci> ot 
the .05 level • 
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TSBLE ft-lII-5 



Occupations at— £'< 



UMoptH FblloW-up» Hales 



Particjpanis 
h=99 



comparisons 



Food service wprlce.rs 
Of f ice/clerical 
Health care 
General iabdr 
Operatives 
Crafts workers 
Other 



18% 
21 
4% 
37% 
111 
19% 
9% 



16% 
1% 
41 
40% 
15% 
15% 
10% 



TABLE R-TII-e 



Occupy 



24 to 40-Wonth Folic ti^-UPr 



Participants 
n«80 



xsons 



•j=81 



Food serV- ce wctrkers 
Office/clerical 
Health e-?ire/child care 
General labor 

Cperativos 

Crafts worKers 
Othet 



30% 
20% 
14% 
15% 
14% 
It 
41 



22% 
17% 
15% 

91 
11% 

4% 
111 



Labor Forc^ Status at 24 to 40-mbnth Follbv-up 
and Reasons Gt^^en— £oil Nqc Beihg-in the Labor Force 



Males 



Wbrkimg 

Lbbkihg fbr work 

Cat of the labor force: 

-cannot find work 

-lacks necessary schooling 
or training 

-farnily respij^nsibil i ties 

-in school or training 

-ill heal tS 

-no ttansportati on 

-in jsii 

- > reason given 



Fcitiales 



Wbrkii^g 

tbokinc fir vrork 

Gat of t^^*^ tabor fbree 

-beldi.?cs no ^brk availabl© 

-c&jinbt find work 

-lacks ne^cessaty 5;7hcpiirig or 

training 
-cannot arrange chl Id care 
-fas^iiy responsibility 
-in school or training 
-ill heialth 
-preghamt 

-no traiDsportat ibh 
-in jail 



^ipant^ Compar ^isbhs 



54% 


49% 


31% 


37% 


1% 


flt 




0% 


1 t 


i% 




it 


1 % 




X K 










3% 


X R7 17 » 


100T 

JL V V ^ 






39* 


37% 


1% 


if 




It 


S% 


3f 


7% 


5% 


10% 


6f 


4% 


21 


1% 


?,% 


6% 


6% 


11 


1% 


1% 


0% 


19W 





o . 88 
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APPENDIX B 



POOLINH VS. WAVE-BY-WAVE ESTIMATION 

In determininjg changes iri program iiispacts over time, there is 
some question whether prograitu effects should be estimated using a 
pooleddata set of all three follow-up waves or using each of the 
three fdllbw-up waves individually. Recent evaluations of youth 
employment programs done for the Department of Labor have taken 
alternative approaches^ The fbllbw-up evaluation of the Job 
Corps, fo^ example^ used pooled data. The_ foUbw-up evaluation 
of the impact of supported work oh disadvantaged youth used 
unpdoled, wave-by-wave data. 

Using pbbled data increaoes the sample size and thus lowers 
the standard errors bf estimates. The use^ of pooled data^ 
however, restricts tUe coefficients of indeper^dent variables to 
be che same across time peripds. The use of pooled data also 
means that the observatibhs shbuld appropriately be weighted by 
an error-components technique to remove possible correlation m 
the variances of the error tenris uf different b^servatibn^ 
same individual. This orxor-componeit^ method is straightfbrwar^ 
wneh used with brdihary least squarc*s est imat ion^ In this 
evaluation^ in which the dependent variables for the roost^ part 
require either ^. maximum liS^elihbod or method; of moments estima- 
tion procedure, the errbr-compchehts technique presents more of a 
problem. If pooled observations are hot wsightedi the resulting 
estim^tdis of program effects are stiU unbiased^ but the standard 
Errors may be inappropriately low, 

Tb take into account possibj^^ differences in estimated 
efft^cts using pooled and unpooled duta^ we presented the results 
in Chapter III using both pooled and wave-by--wave data. In the 
wave-by-wave_ analysis, the 7 to 12 montfti resi;^>^>.^ cbm<? entirely 
from the "S'^-mbnth. f bllbw^up wave, the 13 to iS ah^^ 24 
mtonth results c^Dtne from the •'14"'-iirbnth follow-^up wave and the 2* 
to 29, 30 to 35, and 36 to 40 mbhth result§, rome from the 24 tc 
43-month foi low-up wave^ 

As is clear in the summary table at the end of Chapter III 
the results are very similar v?he:her pooled or waye-by-wave data 
are usi?d . The pooled eatimatfs 'Jo have lower standard errors, 
in part, this in due t<^ the larger sample sizes in the pooled 
data s€^t and in part due to th^ fact that the standard errors may 

inappropriately l^w becau^sa the observations have been -left 
un^reighted. 
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